-- Logs begin at Fri 2021-04-30 12:32:47 UTC, end at Fri 2021-04-30 14:08:43 UTC. -- Apr 30 13:08:20.697456 dv-cinder-788364-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 30 13:08:20.705085 dv-cinder-788364-2-iscsi devstack@n-api.service[73110]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 30 13:08:20.710053 dv-cinder-788364-2-iscsi devstack@n-api.service[73110]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Apr 30 13:08:20 2021] *** Apr 30 13:08:20.710053 dv-cinder-788364-2-iscsi devstack@n-api.service[73110]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 30 13:08:20.710053 dv-cinder-788364-2-iscsi devstack@n-api.service[73110]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 30 13:08:20.710053 dv-cinder-788364-2-iscsi devstack@n-api.service[73110]: nodename: dv-cinder-788364-2-iscsi Apr 30 13:08:20.710053 dv-cinder-788364-2-iscsi devstack@n-api.service[73110]: machine: x86_64 Apr 30 13:08:20.710053 dv-cinder-788364-2-iscsi devstack@n-api.service[73110]: clock source: unix Apr 30 13:08:20.710053 dv-cinder-788364-2-iscsi devstack@n-api.service[73110]: pcre jit disabled Apr 30 13:08:20.710053 dv-cinder-788364-2-iscsi devstack@n-api.service[73110]: detected number of CPU cores: 4 Apr 30 13:08:20.710053 dv-cinder-788364-2-iscsi devstack@n-api.service[73110]: current working directory: / Apr 30 13:08:20.710053 dv-cinder-788364-2-iscsi devstack@n-api.service[73110]: detected binary path: /usr/bin/uwsgi-core Apr 30 13:08:20.710053 dv-cinder-788364-2-iscsi devstack@n-api.service[73110]: your processes number limit is 47680 Apr 30 13:08:20.710053 dv-cinder-788364-2-iscsi devstack@n-api.service[73110]: your memory page size is 4096 bytes Apr 30 13:08:20.710053 dv-cinder-788364-2-iscsi devstack@n-api.service[73110]: detected max file descriptor number: 2048 Apr 30 13:08:20.710053 dv-cinder-788364-2-iscsi devstack@n-api.service[73110]: lock engine: pthread robust mutexes Apr 30 13:08:20.710053 dv-cinder-788364-2-iscsi devstack@n-api.service[73110]: thunder lock: enabled Apr 30 13:08:20.710053 dv-cinder-788364-2-iscsi devstack@n-api.service[73110]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 30 13:08:20.710053 dv-cinder-788364-2-iscsi devstack@n-api.service[73110]: Python version: 3.8.5 (default, Jan 27 2021, 15:41:15) [GCC 9.3.0] Apr 30 13:08:20.749919 dv-cinder-788364-2-iscsi devstack@n-api.service[73110]: Python main interpreter initialized at 0x55bf7e13d9c0 Apr 30 13:08:20.749919 dv-cinder-788364-2-iscsi devstack@n-api.service[73110]: python threads support enabled Apr 30 13:08:20.749919 dv-cinder-788364-2-iscsi devstack@n-api.service[73110]: your server socket listen backlog is limited to 100 connections Apr 30 13:08:20.749919 dv-cinder-788364-2-iscsi devstack@n-api.service[73110]: your mercy for graceful operations on workers is 90 seconds Apr 30 13:08:20.750265 dv-cinder-788364-2-iscsi devstack@n-api.service[73110]: mapped 403077 bytes (393 KB) for 2 cores Apr 30 13:08:20.750362 dv-cinder-788364-2-iscsi devstack@n-api.service[73110]: *** Operational MODE: preforking *** Apr 30 13:08:20.750635 dv-cinder-788364-2-iscsi devstack@n-api.service[73110]: *** uWSGI is running in multiple interpreter mode *** Apr 30 13:08:20.750635 dv-cinder-788364-2-iscsi devstack@n-api.service[73110]: spawned uWSGI master process (pid: 73110) Apr 30 13:08:20.750834 dv-cinder-788364-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 30 13:08:20.751389 dv-cinder-788364-2-iscsi devstack@n-api.service[73110]: spawned uWSGI worker 1 (pid: 73111, cores: 1) Apr 30 13:08:20.751733 dv-cinder-788364-2-iscsi devstack@n-api.service[73110]: spawned uWSGI worker 2 (pid: 73112, cores: 1) Apr 30 13:08:20.751886 dv-cinder-788364-2-iscsi devstack@n-api.service[73110]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 30 13:08:22.362881 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 30 13:08:22.362881 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: from cryptography.utils import int_from_bytes Apr 30 13:08:22.363519 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 30 13:08:22.363519 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: from cryptography.utils import int_from_bytes Apr 30 13:08:22.365740 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 30 13:08:22.365740 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: from cryptography.utils import int_from_bytes Apr 30 13:08:22.366234 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 30 13:08:22.366234 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: from cryptography.utils import int_from_bytes Apr 30 13:08:25.032829 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 30 13:08:25.033351 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 30 13:08:25.033568 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 30 13:08:25.033939 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 30 13:08:25.034229 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 30 13:08:25.034627 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.034962 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.035331 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.035538 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 30 13:08:25.035911 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.036012 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 30 13:08:25.036098 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.036262 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 30 13:08:25.036348 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.036596 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.036693 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 30 13:08:25.036869 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 30 13:08:25.036953 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.037242 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.037332 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.037509 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.037596 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.037830 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.037914 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.038183 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-788364-2-iscsi {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.038287 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.038513 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.038598 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.038822 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.038911 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.039136 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.039227 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.039449 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.039532 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.039761 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.039864 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.040028 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.040136 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.040343 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.040427 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.040666 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-788364-2-iscsi {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.040869 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.041260 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.041260 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.041537 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.041650 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.041756 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.041859 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.041970 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.042195 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.042393 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.042577 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.042739 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.042819 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.042897 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.043197 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.043277 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.043511 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.043597 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.043838 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.043933 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.044151 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.044486 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.044731 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-788364-2-iscsi {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.044827 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.045047 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.045129 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.045356 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.045488 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.045696 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.045784 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.046138 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.046271 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.046489 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.046733 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.046881 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.047063 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.047211 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.047393 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-788364-2-iscsi {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.047524 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.047715 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.047842 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.048030 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.048199 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.048348 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.048488 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.048766 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.048864 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.049082 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.049168 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.049392 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.049483 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.049716 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.049808 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.050044 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.050136 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.050365 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.050460 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.050674 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.050759 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.050983 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.051070 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.051244 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.051330 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.051556 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.051648 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.051883 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.051969 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.052201 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.052291 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.052511 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.052653 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.052769 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.052855 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.053026 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.053114 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.053350 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.053448 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.053655 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.053739 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.053962 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.054067 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.054302 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.054388 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.054615 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.054700 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.054926 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.055012 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.055176 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.055261 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.055428 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.055524 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.055748 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.055845 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.056070 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.056164 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.056378 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.056463 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.056688 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.056782 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.057001 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.057087 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.057307 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.057398 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.057614 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.057711 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.057926 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.058064 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.058252 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.058340 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.058561 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.058678 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.058878 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.058964 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.059192 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.059278 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.059514 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.059612 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.059822 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.059907 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.060142 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.060229 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.060495 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.060587 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.060777 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.060861 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.061084 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.061176 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.062054 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.062150 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.062428 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.062552 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.062782 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.062872 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.063041 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.063190 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.063351 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.063518 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.063664 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.063830 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.063991 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.064141 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.064305 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.064453 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.064619 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.064778 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.064931 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.065104 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.065236 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.065412 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.065549 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.065666 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.065861 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.065967 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.066199 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.066297 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.066511 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.066611 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.066824 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.066909 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.067133 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.067218 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.067443 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.067537 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.067754 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.067839 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.068064 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.068156 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.068369 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.068462 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.068676 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.068762 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.068985 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.069071 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.069291 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.069384 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.069595 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.069681 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.069902 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.069987 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.070234 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.070330 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.070539 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.070632 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.070849 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.070942 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.071167 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.071259 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.071473 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.071558 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.071777 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.071865 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.072084 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.072180 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.072389 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.072490 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.072700 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.072784 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.073003 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.073091 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.073306 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.073399 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.073614 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.073699 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.073919 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.074035 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.074247 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.074338 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.074558 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.074641 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.074862 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.074947 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.075168 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.075253 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.075475 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.075560 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.075773 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.075859 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.076079 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.076207 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.076385 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.076470 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.076688 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.076780 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.077556 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.077703 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.078001 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.078155 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.078308 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.078483 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.078622 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.078800 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.078933 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.079114 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.079259 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.079425 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.079604 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.079734 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.079943 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.080041 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.080294 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.080386 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.080617 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.080709 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.080958 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.081056 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.081267 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.081351 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.081576 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.081661 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.081899 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:08:25.081985 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.082256 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.082341 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.082589 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.082685 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.082908 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.082995 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.083227 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.083313 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.083547 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.083632 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.083875 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.083961 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.084195 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.084280 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.084510 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.084608 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.084829 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.084915 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.085149 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.085232 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.085462 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.085553 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.085775 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.085884 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.086117 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.086270 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.086440 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.086532 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.086762 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.086850 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.087078 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.087163 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.087405 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.087499 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.087730 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.087824 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.088051 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.088137 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.088365 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.088463 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.088684 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.088770 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.089008 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.089092 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.089330 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.089425 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.089641 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.089725 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.089976 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.090115 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.090325 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.090423 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.090650 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.091141 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.091141 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.091298 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.091298 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.091451 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.091587 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.091676 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.091902 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.091987 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.092216 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.092393 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.092546 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.092684 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.092881 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.093117 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.093220 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.093498 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.093582 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.093823 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.093909 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.094190 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.094294 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.094506 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.094594 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.094825 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.094910 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.095134 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.095228 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.095442 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.095535 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.095749 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.095835 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.096059 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.096143 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.096364 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.096447 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.096682 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.096764 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.096994 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.097080 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.097300 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.097392 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.097628 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.097711 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.097934 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.098070 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.098270 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.098376 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.098585 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.098676 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.098931 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.099031 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.099204 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.099293 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.099514 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.099677 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.099819 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.099912 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.100133 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.100217 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.100443 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.100540 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.100753 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.100838 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.101074 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.101159 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.101376 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.101472 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.101681 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.101773 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.101996 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.102100 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.102329 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.102428 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.102643 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.102730 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.102954 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.103090 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.103278 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.103377 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.103592 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.103678 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.103904 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.103997 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.104215 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.104301 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.104527 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.104613 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.104847 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.104943 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.105158 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.105246 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.105471 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.105557 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.105783 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.105875 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.106116 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.106205 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.106432 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.106675 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.106838 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.106925 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.107020 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.107110 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.107318 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.107416 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.107630 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.107726 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.107936 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.108029 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.108319 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.108468 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.108624 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.108790 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.108962 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.109118 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.109284 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.109429 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.109618 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.109757 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.109944 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.110094 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.110292 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.110404 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.110609 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.110704 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.110923 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.111008 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.111242 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.111336 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.111580 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.111678 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.111894 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.111979 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.112212 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.112304 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.112522 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.112610 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.112841 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.112926 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.113155 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.113238 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.113463 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.113550 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.113769 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.113861 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.114105 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.114195 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.114436 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.114564 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.114752 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.114840 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.115070 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.115156 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.115389 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.115476 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.115702 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.115787 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.116012 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.116097 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.116329 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.116422 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.116649 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.116734 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.116956 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.117053 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.117272 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.117356 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.117579 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.117664 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.117896 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.117993 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.118234 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.118318 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.118540 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.118634 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.118846 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.118939 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.119155 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.119238 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.119469 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.119553 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.119779 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.119877 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.120087 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.120172 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.120392 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.120476 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.120708 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.120803 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.121020 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.121122 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.121317 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.121402 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.121619 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.121706 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.121929 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.122062 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.122267 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.122352 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.122579 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.122665 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.122903 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.122989 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.123226 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.123311 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.123531 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.123616 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.124371 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.124464 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.124698 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.124965 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.125125 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.125298 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.125453 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.125611 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.125774 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.125921 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.126115 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.126256 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.126450 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.126602 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.126773 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.126916 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.127091 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.127224 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.127411 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.127543 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.127727 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.127867 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.128044 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.128182 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.128360 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.128496 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.128690 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.128808 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.129006 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.129118 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.129325 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.129442 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.129642 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.129804 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.129952 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.130106 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.130365 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.130452 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.130682 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.130767 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.130994 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.131261 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.131357 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.131603 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.131702 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.131912 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.132011 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.132223 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.132315 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.132534 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.132631 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.132838 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.132923 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.133146 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.133231 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.133460 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.133557 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.133829 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.134039 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.134167 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.134381 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.134483 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.134704 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.134790 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.135029 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.135114 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.135353 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.135451 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.135676 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.135762 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.135985 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.136067 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.136295 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.136389 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.136612 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.136697 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.136922 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.137005 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.137229 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.137321 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.137531 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.137614 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.137835 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.137921 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.138174 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.138260 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.138484 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.138567 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.138790 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.138886 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.139095 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.139186 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.139425 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.140111 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.140363 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.140447 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.140681 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.140804 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.140994 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.141116 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.141307 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.141424 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.141657 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.141755 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.141975 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.142118 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.142351 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.142438 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.142658 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.142759 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.142982 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.143077 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.143296 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.143394 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.143603 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.143693 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.143907 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.143992 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.144212 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.144308 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.144540 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.144624 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.144845 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.144928 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.145159 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.145252 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.145470 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.145557 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.145788 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.145880 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.146143 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.146246 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.146448 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.146539 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.146758 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.146856 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.147062 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.147150 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.147366 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.147460 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.147676 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.147772 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.147982 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.148066 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.148287 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.148372 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.148590 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.148673 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.148904 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.148998 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.149207 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.149303 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.149508 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.149594 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.149815 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.149900 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.150141 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.150242 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.150458 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.150544 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.150760 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.150845 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.151061 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.151155 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.151363 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.151453 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.151670 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.151755 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.151978 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.152064 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.152278 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.152363 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.152600 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.152685 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.152909 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.152995 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.153211 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.153303 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.153519 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.153649 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.153818 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.153903 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.154144 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.154234 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.154455 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.154542 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.154762 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.154849 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.155124 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.155251 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.155451 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.155687 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.155774 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.156064 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.156149 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.156376 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.156478 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.156685 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.156782 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.156991 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.157123 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.157299 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.157383 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.157602 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.157689 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.157905 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.157997 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.158240 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.158326 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.158546 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.158633 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.158851 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.158935 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.159173 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.159267 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.159484 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.159571 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.159788 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.159873 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.160090 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.160183 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.160392 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.160478 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.160735 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.160820 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.161038 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.161136 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.161355 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.161439 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.161666 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.161751 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.161980 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.162142 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.162320 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.162406 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.162631 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.162723 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.162942 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.163037 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.163255 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.163341 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.163557 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.163642 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.163869 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.163966 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.164179 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.164264 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.164490 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.164581 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.164791 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.164877 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.165094 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.165185 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.165405 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.165498 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.165714 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.165800 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.166038 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.166139 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.166360 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.166448 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.166677 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.166764 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.166993 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.167079 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.167301 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.167416 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.167609 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.167694 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.167916 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.167999 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.168229 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.168322 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.168535 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.168619 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.168843 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.168928 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.169152 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.169509 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.169723 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.169814 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.170048 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.170134 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.170365 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.170465 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.170703 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.170793 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.171014 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.171236 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.171451 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.171745 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.171834 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.172064 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.172157 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.172372 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.172467 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.172686 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.172770 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.172998 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.173082 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.173302 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.173395 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.173612 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.173697 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.173917 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.174032 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.174253 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.174353 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.174557 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.174674 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.174983 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.175070 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.175297 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.175394 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.175603 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.175687 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.175909 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.175992 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.176216 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.176312 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.176529 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.176622 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.176840 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.176924 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.177150 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.177280 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.177450 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.177536 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.177776 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.177860 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.178110 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.178201 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.178440 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.178528 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.178795 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.178881 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.179099 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.179186 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.179401 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.179493 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.179710 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.179869 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.180036 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.180188 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.180340 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.180505 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.180642 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.180834 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.180948 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.181162 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.181269 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.181492 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.181623 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.181803 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.181891 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.182153 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.182321 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.182474 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.182632 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.182808 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.182936 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.183139 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.183350 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.183460 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.183664 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.183783 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.183974 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.184095 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.184295 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.184426 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.184614 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.184774 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.184937 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.185066 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.185242 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.185396 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.185556 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.185820 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.185915 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.186176 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.186819 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.187006 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.187109 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.187335 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.187631 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.187725 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.187956 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.188042 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.188263 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.188348 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.188579 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.188666 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.188892 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.188985 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.189204 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.189291 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.189525 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.189609 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.189834 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.189948 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.190176 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.190303 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.190497 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.190616 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.190812 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.190938 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.191120 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.191264 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.191430 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.191568 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.191762 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.191861 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.192071 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.192157 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.192399 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.192485 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.192723 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.192817 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.193052 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.193137 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.193355 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.193451 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.193664 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.193759 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.193973 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.194131 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.194307 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.194393 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.194611 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.194712 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.194915 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.195001 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.195224 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.195320 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.195525 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.195610 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.195846 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.195931 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.196159 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.196244 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.196483 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.196570 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.196803 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.196891 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.197108 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.197200 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.197429 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.197522 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.197736 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.197829 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.198058 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.198160 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.198363 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.198456 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.198671 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.198757 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.199013 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.199108 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.199318 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.199403 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.199631 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.199715 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.199941 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.200040 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.200251 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.200356 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.200561 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.200647 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.200877 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.200962 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.201187 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.201285 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.201496 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.201583 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.201805 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.201917 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.202765 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.202874 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.203084 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.203360 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.203446 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.203678 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.203763 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.203995 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.204124 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.204307 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.204393 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.204616 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.204710 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.204924 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.205010 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.205236 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.205359 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.205542 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.205640 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.205845 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.205931 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.206174 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.206274 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.206500 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.206599 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.206805 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.206891 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.207129 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.207222 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.207439 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.207533 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.207744 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.207866 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.208050 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.208138 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.208354 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.208449 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.208704 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.208789 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.209008 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.209094 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.209327 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.209413 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.209644 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.209730 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.209966 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.210069 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.210312 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.210406 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.210623 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.210708 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.210949 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.211156 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.211251 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.211493 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.211579 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.211816 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.211904 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.212138 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.212233 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.212458 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.212545 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.212779 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.212862 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.213093 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.213181 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.213406 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.213492 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.213719 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.213804 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.214050 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.214154 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.214375 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.214475 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.214705 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.214895 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.215036 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.215226 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.215374 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.215544 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.215722 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.215860 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.216045 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.216174 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.216366 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.216495 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.216685 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.216811 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.217009 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.217124 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.217376 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.217467 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.217745 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.217927 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.218079 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.218408 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.218505 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.218734 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.218834 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.219058 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.219145 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.219381 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.219468 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.219703 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.219802 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.220022 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.220108 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.220349 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.220470 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.220662 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.220771 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.220975 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.221071 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.221294 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.221390 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.221614 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.221711 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.221938 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.222062 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.222297 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.222386 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.222620 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.222720 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.222937 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.223023 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.223251 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.223345 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.223569 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.223655 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.223882 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.224094 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.224201 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.224419 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.224510 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.224761 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.224848 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.225096 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.225182 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.225411 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.225497 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.225741 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.225833 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.226094 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.226186 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.226414 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.226509 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.226727 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.226813 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.227035 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.227128 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.227349 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.227433 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.227666 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.227865 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.227978 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.228187 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.228308 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.228529 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.228614 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.228860 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.228946 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.229189 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.229277 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.229508 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.229594 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.229829 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.230087 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.230189 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.230450 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.230543 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.230773 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.230860 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.231086 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.231172 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.231399 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.231492 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.231703 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.231789 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.232026 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.232114 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.232338 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.232423 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.232643 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.232737 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.232962 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.233048 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.233298 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.233387 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.233673 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.233962 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.234108 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.234298 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.234462 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.234616 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.234782 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.234931 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.235114 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.235229 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.235442 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.235548 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.235761 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.235902 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.236069 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.236177 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.236396 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.236489 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.236704 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.236799 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.237011 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.237097 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.237326 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.237413 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.237637 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.237735 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.237940 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.238109 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.238272 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.238361 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.238587 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.238688 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.238896 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.238983 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.239201 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.239285 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.239510 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.239597 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.239814 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.239907 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.240127 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.240211 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.240432 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.240518 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.240734 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.240820 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.241036 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.241128 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.241347 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.241434 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.241650 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.241736 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.241952 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.242067 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.242282 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.242369 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.242584 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.242672 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.242893 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.242979 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.243194 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.243281 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.243502 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.243588 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.243806 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.243900 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.244113 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.244199 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.244415 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.244701 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.244795 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.245015 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.245101 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.245335 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.245421 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.245639 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.245725 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.245943 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.246049 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.246281 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.246368 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.246594 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.246680 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.246917 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.247005 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.247229 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.247322 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.247540 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.247626 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.247858 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.247951 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.248177 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.248263 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.248495 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.248717 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.249382 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.249720 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.249955 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.250258 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.250345 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.250609 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.250698 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.250946 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.251032 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.251255 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.251341 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.251565 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.251652 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.251872 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.251958 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.252195 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.252330 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.252510 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.252596 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.252823 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.252916 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.253135 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.253233 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.253447 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.253533 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.253758 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.253844 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.254111 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.254278 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.254442 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.254594 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.254782 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.254908 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.255104 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.255221 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.255419 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.255532 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.255847 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.255934 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.256166 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.256258 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.256484 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.256568 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.256800 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.256885 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.257118 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.257204 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.257425 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.257521 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.257735 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.257829 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.258065 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.258154 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.258379 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.258486 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.258695 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.258802 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.259029 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.259118 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.259343 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.259429 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.259647 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.259741 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.260058 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.260150 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.260368 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.260453 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.260686 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.260782 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.261005 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.261092 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.261317 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.261410 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.261645 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.261740 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.261962 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.262067 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.262306 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.262430 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.262625 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.262714 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.262944 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.263030 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.263246 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.263332 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.263553 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.263647 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.263864 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.263950 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.264203 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.264287 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.265114 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.265227 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.265428 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.265657 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.265765 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.265986 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.266150 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.266344 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.266433 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.266664 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.266752 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.266978 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.267077 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.267293 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.267379 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.267606 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.267691 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.267918 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.268008 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.268239 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.268326 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.268561 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.268646 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.268876 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.268962 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.269187 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.269271 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.269510 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.269598 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.269821 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.269932 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.270160 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.270250 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.270465 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.270550 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.270780 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.270875 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.271088 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.271175 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.271403 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.271502 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.271717 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.271803 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.272033 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.272124 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.272350 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.272436 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.272659 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.272734 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.272982 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.273069 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.273290 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.273385 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.273611 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.273697 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.273931 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.274061 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.274270 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.274365 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.274579 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.274665 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.274897 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.274981 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.275208 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.275294 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.275517 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.275603 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.275828 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.275920 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.276139 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.276282 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.276449 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.276536 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.276892 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.277137 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.277343 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.277458 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.277549 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.277736 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.277825 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.278104 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.278342 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.278464 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.278764 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.278850 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.279123 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.279421 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.279516 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.279783 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.279923 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.280202 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.280456 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.280556 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=73111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 30 13:08:25.280926 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.281250 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.281575 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.281892 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.282238 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.282564 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.282887 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.283220 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.283550 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.283878 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.284207 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.284557 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.284871 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.285218 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.285546 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:08:25.285790 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=73112) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 30 13:08:25.315292 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG oslo_db.sqlalchemy.engines [None req-c1db7853-3427-4862-b301-1c3087d16145 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73111) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 13:08:25.319337 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG oslo_db.sqlalchemy.engines [None req-6f9d36f2-1805-478c-bc97-47d290438836 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73112) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 13:08:25.562992 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.context [None req-c1db7853-3427-4862-b301-1c3087d16145 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c94c5757-8835-44de-a521-d4549117f41a(cell1) {{(pid=73111) load_cells /opt/stack/nova/nova/context.py:464}} Apr 30 13:08:25.565894 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.context [None req-6f9d36f2-1805-478c-bc97-47d290438836 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c94c5757-8835-44de-a521-d4549117f41a(cell1) {{(pid=73112) load_cells /opt/stack/nova/nova/context.py:464}} Apr 30 13:08:25.567314 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG oslo_concurrency.lockutils [None req-c1db7853-3427-4862-b301-1c3087d16145 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=73111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:08:25.568998 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG oslo_concurrency.lockutils [None req-c1db7853-3427-4862-b301-1c3087d16145 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=73111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:08:25.569799 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG oslo_concurrency.lockutils [None req-c1db7853-3427-4862-b301-1c3087d16145 None None] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=73111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:08:25.570220 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG oslo_concurrency.lockutils [None req-6f9d36f2-1805-478c-bc97-47d290438836 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=73112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:08:25.571805 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG oslo_concurrency.lockutils [None req-c1db7853-3427-4862-b301-1c3087d16145 None None] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=73111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:08:25.571926 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG oslo_concurrency.lockutils [None req-6f9d36f2-1805-478c-bc97-47d290438836 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=73112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:08:25.572736 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG oslo_concurrency.lockutils [None req-6f9d36f2-1805-478c-bc97-47d290438836 None None] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=73112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:08:25.574743 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG oslo_concurrency.lockutils [None req-6f9d36f2-1805-478c-bc97-47d290438836 None None] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=73112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:08:25.599980 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG oslo_db.sqlalchemy.engines [None req-c1db7853-3427-4862-b301-1c3087d16145 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73111) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 13:08:25.600823 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG oslo_db.sqlalchemy.engines [None req-c1db7853-3427-4862-b301-1c3087d16145 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73111) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 13:08:25.608374 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG oslo_db.sqlalchemy.engines [None req-6f9d36f2-1805-478c-bc97-47d290438836 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73112) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 13:08:25.609274 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG oslo_db.sqlalchemy.engines [None req-6f9d36f2-1805-478c-bc97-47d290438836 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73112) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 13:08:25.632020 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG oslo_db.sqlalchemy.engines [None req-c1db7853-3427-4862-b301-1c3087d16145 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73111) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 13:08:25.640480 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG oslo_db.sqlalchemy.engines [None req-6f9d36f2-1805-478c-bc97-47d290438836 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73112) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 13:08:26.057468 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: WARNING keystonemiddleware.auth_token [None req-c1db7853-3427-4862-b301-1c3087d16145 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 30 13:08:26.060879 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: WARNING keystonemiddleware.auth_token [None req-6f9d36f2-1805-478c-bc97-47d290438836 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 30 13:08:26.064831 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: WARNING keystonemiddleware.auth_token [None req-c1db7853-3427-4862-b301-1c3087d16145 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 30 13:08:26.068076 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: WARNING keystonemiddleware.auth_token [None req-6f9d36f2-1805-478c-bc97-47d290438836 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 30 13:08:26.280846 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: WARNING keystonemiddleware.auth_token [None req-c1db7853-3427-4862-b301-1c3087d16145 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 30 13:08:26.284601 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: WARNING keystonemiddleware.auth_token [None req-6f9d36f2-1805-478c-bc97-47d290438836 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 30 13:08:26.286173 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: WARNING keystonemiddleware.auth_token [None req-c1db7853-3427-4862-b301-1c3087d16145 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 30 13:08:26.289828 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: WARNING keystonemiddleware.auth_token [None req-6f9d36f2-1805-478c-bc97-47d290438836 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 30 13:08:26.291512 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bf7e13d9c0 pid: 73111 (default app) Apr 30 13:08:26.293635 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi [None req-c1db7853-3427-4862-b301-1c3087d16145 None None] Calling method '>' {{(pid=73111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:08:26.295053 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: INFO nova.api.openstack.requestlog [None req-c1db7853-3427-4862-b301-1c3087d16145 None None] 10.222.0.79 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001982 Apr 30 13:08:26.295466 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bf7e13d9c0 pid: 73112 (default app) Apr 30 13:08:26.295655 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: [pid: 73111|app: 0|req: 1/1] 10.222.0.79 () {50 vars in 789 bytes} [Fri Apr 30 13:08:26 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:09:47.145510 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi [None req-c1db7853-3427-4862-b301-1c3087d16145 None None] Calling method '>' {{(pid=73111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:09:47.147379 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: INFO nova.api.openstack.requestlog [None req-c1db7853-3427-4862-b301-1c3087d16145 None None] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002293 Apr 30 13:09:47.147936 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: [pid: 73111|app: 0|req: 2/2] 10.222.0.79 () {54 vars in 930 bytes} [Fri Apr 30 13:09:47 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:09:47.738924 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi [None req-d1d8b292-2cd8-412c-aa71-c28b5f7d1d98 admin admin] Calling method '>' {{(pid=73112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:09:47.766713 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: INFO nova.api.openstack.requestlog [None req-d1d8b292-2cd8-412c-aa71-c28b5f7d1d98 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.611136 Apr 30 13:09:47.767619 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: [pid: 73112|app: 0|req: 1/3] 10.222.0.79 () {60 vars in 1291 bytes} [Fri Apr 30 13:09:47 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:09:49.923902 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi [None req-c1db7853-3427-4862-b301-1c3087d16145 None None] Calling method '>' {{(pid=73111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:09:49.924966 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: INFO nova.api.openstack.requestlog [None req-c1db7853-3427-4862-b301-1c3087d16145 None None] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Apr 30 13:09:49.925663 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: [pid: 73111|app: 0|req: 3/4] 10.222.0.79 () {54 vars in 930 bytes} [Fri Apr 30 13:09:49 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:09:49.989780 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi [None req-97f7692b-1177-48c2-9628-f5f16d989921 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "swap": 0, "vcpus": 1, "id": "c1", "disk": 1, "ram": 256, "os-flavor-access:is_public": true}} {{(pid=73112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:09:50.008726 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:09:50.008726 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: warnings.warn(msg) Apr 30 13:09:50.036898 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: INFO nova.api.openstack.requestlog [None req-97f7692b-1177-48c2-9628-f5f16d989921 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.103800 Apr 30 13:09:50.037475 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: [pid: 73112|app: 0|req: 2/5] 10.222.0.79 () {64 vars in 1282 bytes} [Fri Apr 30 13:09:49 2021] POST /compute/v2.1/flavors => generated 407 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:09:50.269815 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi [None req-579d75a3-82f4-49f9-880f-ae5f3bb87c52 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=73111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:09:50.272315 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:09:50.272315 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: warnings.warn(msg) Apr 30 13:09:50.430072 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: INFO nova.api.openstack.requestlog [None req-579d75a3-82f4-49f9-880f-ae5f3bb87c52 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.384120 Apr 30 13:09:50.431134 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: [pid: 73111|app: 0|req: 4/6] 10.222.0.79 () {64 vars in 1335 bytes} [Fri Apr 30 13:09:50 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:09:52.607610 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi [None req-97f7692b-1177-48c2-9628-f5f16d989921 admin admin] Calling method '>' {{(pid=73112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:09:52.608625 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: INFO nova.api.openstack.requestlog [None req-97f7692b-1177-48c2-9628-f5f16d989921 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Apr 30 13:09:52.609032 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: [pid: 73112|app: 0|req: 3/7] 10.222.0.79 () {54 vars in 930 bytes} [Fri Apr 30 13:09:52 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:09:52.719300 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi [None req-d5ecc365-596d-4d99-8fb9-336be7c893f2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 512, "id": "d1"}} {{(pid=73111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:09:52.737839 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:09:52.737839 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: warnings.warn(msg) Apr 30 13:09:52.761947 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: INFO nova.api.openstack.requestlog [None req-d5ecc365-596d-4d99-8fb9-336be7c893f2 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.146808 Apr 30 13:09:52.762607 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: [pid: 73111|app: 0|req: 5/8] 10.222.0.79 () {64 vars in 1282 bytes} [Fri Apr 30 13:09:52 2021] POST /compute/v2.1/flavors => generated 404 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 13:09:52.774174 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi [None req-e04af776-5a1b-435b-80bf-a82caf1e6be3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=73112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:09:52.776356 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:09:52.776356 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: warnings.warn(msg) Apr 30 13:09:52.815828 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: INFO nova.api.openstack.requestlog [None req-e04af776-5a1b-435b-80bf-a82caf1e6be3 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045241 Apr 30 13:09:52.816864 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: [pid: 73112|app: 0|req: 4/9] 10.222.0.79 () {64 vars in 1335 bytes} [Fri Apr 30 13:09:52 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:09:55.005820 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi [None req-d5ecc365-596d-4d99-8fb9-336be7c893f2 admin admin] Calling method '>' {{(pid=73111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:09:55.006974 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: INFO nova.api.openstack.requestlog [None req-d5ecc365-596d-4d99-8fb9-336be7c893f2 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001586 Apr 30 13:09:55.007611 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: [pid: 73111|app: 0|req: 6/10] 10.222.0.79 () {54 vars in 930 bytes} [Fri Apr 30 13:09:55 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:09:55.067003 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi [None req-00f86719-50aa-40e4-846c-af63892c5b49 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d2", "os-flavor-access:is_public": true, "disk": 10, "vcpus": 1, "name": "ds1G"}} {{(pid=73112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:09:55.094027 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: INFO nova.api.openstack.requestlog [None req-00f86719-50aa-40e4-846c-af63892c5b49 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.080247 Apr 30 13:09:55.095114 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: [pid: 73112|app: 0|req: 5/11] 10.222.0.79 () {64 vars in 1282 bytes} [Fri Apr 30 13:09:55 2021] POST /compute/v2.1/flavors => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:09:55.107229 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi [None req-c4e2d99f-069b-486f-ad72-77cc0adc08a6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=73111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:09:55.146691 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: INFO nova.api.openstack.requestlog [None req-c4e2d99f-069b-486f-ad72-77cc0adc08a6 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043714 Apr 30 13:09:55.147677 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: [pid: 73111|app: 0|req: 7/12] 10.222.0.79 () {64 vars in 1335 bytes} [Fri Apr 30 13:09:55 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:09:57.301579 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi [None req-00f86719-50aa-40e4-846c-af63892c5b49 admin admin] Calling method '>' {{(pid=73112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:09:57.302590 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: INFO nova.api.openstack.requestlog [None req-00f86719-50aa-40e4-846c-af63892c5b49 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001575 Apr 30 13:09:57.303012 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: [pid: 73112|app: 0|req: 6/13] 10.222.0.79 () {54 vars in 930 bytes} [Fri Apr 30 13:09:57 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:09:57.363176 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi [None req-52f794e2-5d73-402b-b9c7-7c397afaa6e8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "rxtx_factor": 1.0, "disk": 10, "id": "d3", "ram": 2048}} {{(pid=73111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:09:57.389271 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: INFO nova.api.openstack.requestlog [None req-52f794e2-5d73-402b-b9c7-7c397afaa6e8 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.080252 Apr 30 13:09:57.389828 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: [pid: 73111|app: 0|req: 8/14] 10.222.0.79 () {64 vars in 1282 bytes} [Fri Apr 30 13:09:57 2021] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:09:57.403035 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi [None req-10d24e7a-3e7d-44c2-aae5-b51bcf805197 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=73112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:09:57.440645 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: INFO nova.api.openstack.requestlog [None req-10d24e7a-3e7d-44c2-aae5-b51bcf805197 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042787 Apr 30 13:09:57.441319 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: [pid: 73112|app: 0|req: 7/15] 10.222.0.79 () {64 vars in 1335 bytes} [Fri Apr 30 13:09:57 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:09:59.605641 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi [None req-52f794e2-5d73-402b-b9c7-7c397afaa6e8 admin admin] Calling method '>' {{(pid=73111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:09:59.607242 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: INFO nova.api.openstack.requestlog [None req-52f794e2-5d73-402b-b9c7-7c397afaa6e8 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002026 Apr 30 13:09:59.607812 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: [pid: 73111|app: 0|req: 9/16] 10.222.0.79 () {54 vars in 930 bytes} [Fri Apr 30 13:09:59 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:09:59.668100 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi [None req-69235ae9-9140-4b60-b076-3b5549eea777 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 4096, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "id": "d4", "disk": 20, "vcpus": 4}} {{(pid=73112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:09:59.692682 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: INFO nova.api.openstack.requestlog [None req-69235ae9-9140-4b60-b076-3b5549eea777 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079040 Apr 30 13:09:59.693237 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: [pid: 73112|app: 0|req: 8/17] 10.222.0.79 () {64 vars in 1282 bytes} [Fri Apr 30 13:09:59 2021] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:09:59.705140 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi [None req-2afcc894-efb1-4791-bb3d-a7022c3dacfd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=73111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:09:59.742313 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: INFO nova.api.openstack.requestlog [None req-2afcc894-efb1-4791-bb3d-a7022c3dacfd admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040627 Apr 30 13:09:59.745624 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: [pid: 73111|app: 0|req: 10/18] 10.222.0.79 () {64 vars in 1335 bytes} [Fri Apr 30 13:09:59 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:10:01.903414 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi [None req-69235ae9-9140-4b60-b076-3b5549eea777 admin admin] Calling method '>' {{(pid=73112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:10:01.904427 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: INFO nova.api.openstack.requestlog [None req-69235ae9-9140-4b60-b076-3b5549eea777 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Apr 30 13:10:01.905030 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: [pid: 73112|app: 0|req: 9/19] 10.222.0.79 () {54 vars in 930 bytes} [Fri Apr 30 13:10:01 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:10:01.965885 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi [None req-058e402e-fef3-431e-b407-1c54804d8b17 admin admin] Calling method '>' {{(pid=73111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:10:01.990903 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: INFO nova.api.openstack.requestlog [None req-058e402e-fef3-431e-b407-1c54804d8b17 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.078786 Apr 30 13:10:01.998121 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: [pid: 73111|app: 0|req: 11/20] 10.222.0.79 () {60 vars in 1291 bytes} [Fri Apr 30 13:10:01 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:10:04.144028 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi [None req-69235ae9-9140-4b60-b076-3b5549eea777 admin admin] Calling method '>' {{(pid=73112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:10:04.144926 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: INFO nova.api.openstack.requestlog [None req-69235ae9-9140-4b60-b076-3b5549eea777 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Apr 30 13:10:04.145312 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: [pid: 73112|app: 0|req: 10/21] 10.222.0.79 () {54 vars in 930 bytes} [Fri Apr 30 13:10:04 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:10:04.208362 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi [None req-6e971c80-e77a-4522-8d4e-8ae5faa05c2e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "name": "m1.tiny", "swap": 0, "ram": 512, "os-flavor-access:is_public": true}} {{(pid=73111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:10:04.236005 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: INFO nova.api.openstack.requestlog [None req-6e971c80-e77a-4522-8d4e-8ae5faa05c2e admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.082530 Apr 30 13:10:04.236538 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: [pid: 73111|app: 0|req: 12/22] 10.222.0.79 () {64 vars in 1282 bytes} [Fri Apr 30 13:10:04 2021] POST /compute/v2.1/flavors => generated 402 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:10:04.248134 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi [None req-91e777bd-2757-4592-81b5-65aa390ff419 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=73112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:10:04.282984 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: INFO nova.api.openstack.requestlog [None req-91e777bd-2757-4592-81b5-65aa390ff419 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038443 Apr 30 13:10:04.283818 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: [pid: 73112|app: 0|req: 11/23] 10.222.0.79 () {64 vars in 1332 bytes} [Fri Apr 30 13:10:04 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:10:06.495809 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi [None req-6e971c80-e77a-4522-8d4e-8ae5faa05c2e admin admin] Calling method '>' {{(pid=73111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:10:06.496957 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: INFO nova.api.openstack.requestlog [None req-6e971c80-e77a-4522-8d4e-8ae5faa05c2e admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Apr 30 13:10:06.497306 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: [pid: 73111|app: 0|req: 13/24] 10.222.0.79 () {54 vars in 930 bytes} [Fri Apr 30 13:10:06 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:10:06.557996 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi [None req-751a28e8-967a-4d5c-bc9d-affabbe66ba3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "swap": 0, "rxtx_factor": 1.0, "disk": 20, "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "ram": 2048}} {{(pid=73112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:10:06.582984 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: INFO nova.api.openstack.requestlog [None req-751a28e8-967a-4d5c-bc9d-affabbe66ba3 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.078430 Apr 30 13:10:06.583534 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: [pid: 73112|app: 0|req: 12/25] 10.222.0.79 () {64 vars in 1282 bytes} [Fri Apr 30 13:10:06 2021] POST /compute/v2.1/flavors => generated 405 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 13:10:06.595765 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi [None req-4f3158f0-46ae-423b-bd4a-5efe70f2f578 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=73111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:10:06.630477 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: INFO nova.api.openstack.requestlog [None req-4f3158f0-46ae-423b-bd4a-5efe70f2f578 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038380 Apr 30 13:10:06.631130 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: [pid: 73111|app: 0|req: 14/26] 10.222.0.79 () {64 vars in 1332 bytes} [Fri Apr 30 13:10:06 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:10:08.824647 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi [None req-751a28e8-967a-4d5c-bc9d-affabbe66ba3 admin admin] Calling method '>' {{(pid=73112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:10:08.825672 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: INFO nova.api.openstack.requestlog [None req-751a28e8-967a-4d5c-bc9d-affabbe66ba3 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Apr 30 13:10:08.826360 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: [pid: 73112|app: 0|req: 13/27] 10.222.0.79 () {54 vars in 930 bytes} [Fri Apr 30 13:10:08 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:10:08.887688 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi [None req-45bbce37-2e3a-4cd1-b0c2-a885e8c84121 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "name": "m1.medium", "id": "3", "rxtx_factor": 1.0, "disk": 40, "os-flavor-access:is_public": true, "swap": 0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=73111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:10:08.912311 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: INFO nova.api.openstack.requestlog [None req-45bbce37-2e3a-4cd1-b0c2-a885e8c84121 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.080091 Apr 30 13:10:08.912876 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: [pid: 73111|app: 0|req: 15/28] 10.222.0.79 () {64 vars in 1282 bytes} [Fri Apr 30 13:10:08 2021] POST /compute/v2.1/flavors => generated 406 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 13:10:08.925649 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi [None req-e7bff9e2-39ee-44e6-b1c1-27fd093d4eeb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=73112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:10:08.963864 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: INFO nova.api.openstack.requestlog [None req-e7bff9e2-39ee-44e6-b1c1-27fd093d4eeb admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041945 Apr 30 13:10:08.964453 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: [pid: 73112|app: 0|req: 14/29] 10.222.0.79 () {64 vars in 1332 bytes} [Fri Apr 30 13:10:08 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:10:11.110617 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi [None req-45bbce37-2e3a-4cd1-b0c2-a885e8c84121 admin admin] Calling method '>' {{(pid=73111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:10:11.111646 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: INFO nova.api.openstack.requestlog [None req-45bbce37-2e3a-4cd1-b0c2-a885e8c84121 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Apr 30 13:10:11.112048 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: [pid: 73111|app: 0|req: 16/30] 10.222.0.79 () {54 vars in 930 bytes} [Fri Apr 30 13:10:11 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:10:11.171627 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi [None req-5828f639-b4b5-4361-90c9-60e2640aca32 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.large", "disk": 80, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 8192, "vcpus": 4, "swap": 0}} {{(pid=73112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:10:11.202930 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: INFO nova.api.openstack.requestlog [None req-5828f639-b4b5-4361-90c9-60e2640aca32 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.084721 Apr 30 13:10:11.204129 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: [pid: 73112|app: 0|req: 15/31] 10.222.0.79 () {64 vars in 1282 bytes} [Fri Apr 30 13:10:11 2021] POST /compute/v2.1/flavors => generated 405 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:10:11.216043 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi [None req-bde7e2b5-2dd7-49f9-bb43-3d0e50c34ee7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=73111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:10:11.256661 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: INFO nova.api.openstack.requestlog [None req-bde7e2b5-2dd7-49f9-bb43-3d0e50c34ee7 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044502 Apr 30 13:10:11.257568 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: [pid: 73111|app: 0|req: 17/32] 10.222.0.79 () {64 vars in 1332 bytes} [Fri Apr 30 13:10:11 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:10:13.527400 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi [None req-5828f639-b4b5-4361-90c9-60e2640aca32 admin admin] Calling method '>' {{(pid=73112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:10:13.528416 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: INFO nova.api.openstack.requestlog [None req-5828f639-b4b5-4361-90c9-60e2640aca32 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Apr 30 13:10:13.528817 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: [pid: 73112|app: 0|req: 16/33] 10.222.0.79 () {54 vars in 930 bytes} [Fri Apr 30 13:10:13 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:10:13.591784 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi [None req-31703fbb-db59-4b81-aed6-6f5211f9fa3f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "id": "5", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "vcpus": 8, "name": "m1.xlarge", "rxtx_factor": 1.0, "swap": 0}} {{(pid=73111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:10:13.615951 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: INFO nova.api.openstack.requestlog [None req-31703fbb-db59-4b81-aed6-6f5211f9fa3f admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.081154 Apr 30 13:10:13.617092 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: [pid: 73111|app: 0|req: 18/34] 10.222.0.79 () {64 vars in 1282 bytes} [Fri Apr 30 13:10:13 2021] POST /compute/v2.1/flavors => generated 408 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 13:10:13.628554 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi [None req-93de8aff-6826-4b1d-9d1d-97ea9f414ee8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=73112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:10:13.667975 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: INFO nova.api.openstack.requestlog [None req-93de8aff-6826-4b1d-9d1d-97ea9f414ee8 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042987 Apr 30 13:10:13.669193 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: [pid: 73112|app: 0|req: 17/35] 10.222.0.79 () {64 vars in 1332 bytes} [Fri Apr 30 13:10:13 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:10:52.883704 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi [None req-31703fbb-db59-4b81-aed6-6f5211f9fa3f admin admin] Calling method '>' {{(pid=73111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:10:52.884750 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: INFO nova.api.openstack.requestlog [None req-31703fbb-db59-4b81-aed6-6f5211f9fa3f admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Apr 30 13:10:52.885184 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: [pid: 73111|app: 0|req: 19/36] 10.222.0.79 () {54 vars in 930 bytes} [Fri Apr 30 13:10:52 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:10:52.942103 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi [None req-012f9c1c-4f31-42bc-b7fb-88e3c5e75c55 admin admin] Calling method '>' {{(pid=73112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:10:52.965487 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: INFO nova.api.openstack.requestlog [None req-012f9c1c-4f31-42bc-b7fb-88e3c5e75c55 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.074455 Apr 30 13:10:52.966048 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: [pid: 73112|app: 0|req: 18/37] 10.222.0.79 () {60 vars in 1291 bytes} [Fri Apr 30 13:10:52 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:10:54.362785 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi [None req-31703fbb-db59-4b81-aed6-6f5211f9fa3f admin admin] Calling method '>' {{(pid=73111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:10:54.363785 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: INFO nova.api.openstack.requestlog [None req-31703fbb-db59-4b81-aed6-6f5211f9fa3f admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Apr 30 13:10:54.364188 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: [pid: 73111|app: 0|req: 20/38] 10.222.0.79 () {56 vars in 1075 bytes} [Fri Apr 30 13:10:54 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:10:54.550634 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi [None req-2a4e7743-b79d-4f79-9097-dc245d1a0f44 admin admin] Calling method '>' {{(pid=73112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:10:54.563555 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: INFO nova.api.openstack.wsgi [None req-2a4e7743-b79d-4f79-9097-dc245d1a0f44 admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 30 13:10:54.564141 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi [None req-2a4e7743-b79d-4f79-9097-dc245d1a0f44 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=73112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:10:54.564941 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: INFO nova.api.openstack.requestlog [None req-2a4e7743-b79d-4f79-9097-dc245d1a0f44 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.064908 Apr 30 13:10:54.565455 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: [pid: 73112|app: 0|req: 19/39] 10.222.0.79 () {60 vars in 1191 bytes} [Fri Apr 30 13:10:54 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 30 13:10:54.574937 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi [None req-e061ea1d-47d4-4bb0-89c1-fb9117c7b0ba admin admin] Calling method '>' {{(pid=73111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:10:54.594799 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: INFO nova.api.openstack.requestlog [None req-e061ea1d-47d4-4bb0-89c1-fb9117c7b0ba admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023474 Apr 30 13:10:54.595345 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: [pid: 73111|app: 0|req: 21/40] 10.222.0.79 () {60 vars in 1211 bytes} [Fri Apr 30 13:10:54 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:10:54.605511 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi [None req-8bdcf991-81fd-4c75-a2aa-da305a4b7ca7 admin admin] Calling method '>' {{(pid=73112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:10:54.625826 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: INFO nova.api.openstack.requestlog [None req-8bdcf991-81fd-4c75-a2aa-da305a4b7ca7 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023820 Apr 30 13:10:54.626386 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: [pid: 73112|app: 0|req: 20/41] 10.222.0.79 () {60 vars in 1211 bytes} [Fri Apr 30 13:10:54 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:10:54.635651 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi [None req-e88dcedf-1ca1-4052-b8ad-314d502715df admin admin] Calling method '>' {{(pid=73111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:10:54.647854 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: INFO nova.api.openstack.wsgi [None req-e88dcedf-1ca1-4052-b8ad-314d502715df admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 30 13:10:54.648435 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi [None req-e88dcedf-1ca1-4052-b8ad-314d502715df admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=73111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:10:54.649229 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: INFO nova.api.openstack.requestlog [None req-e88dcedf-1ca1-4052-b8ad-314d502715df admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.017154 Apr 30 13:10:54.649733 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: [pid: 73111|app: 0|req: 22/42] 10.222.0.79 () {60 vars in 1191 bytes} [Fri Apr 30 13:10:54 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Apr 30 13:10:55.953898 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi [None req-8bdcf991-81fd-4c75-a2aa-da305a4b7ca7 admin admin] Calling method '>' {{(pid=73112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:10:55.954947 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: INFO nova.api.openstack.requestlog [None req-8bdcf991-81fd-4c75-a2aa-da305a4b7ca7 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Apr 30 13:10:55.955351 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: [pid: 73112|app: 0|req: 21/43] 10.222.0.79 () {56 vars in 1075 bytes} [Fri Apr 30 13:10:55 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:10:56.141716 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi [None req-8a6487ee-43f1-4b8d-8577-5c1cefc97039 admin admin] Calling method '>' {{(pid=73111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:10:56.154106 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: INFO nova.api.openstack.wsgi [None req-8a6487ee-43f1-4b8d-8577-5c1cefc97039 admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 30 13:10:56.154683 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi [None req-8a6487ee-43f1-4b8d-8577-5c1cefc97039 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=73111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:10:56.155487 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: INFO nova.api.openstack.requestlog [None req-8a6487ee-43f1-4b8d-8577-5c1cefc97039 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.065519 Apr 30 13:10:56.156006 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: [pid: 73111|app: 0|req: 23/44] 10.222.0.79 () {60 vars in 1191 bytes} [Fri Apr 30 13:10:56 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 30 13:10:56.165961 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi [None req-83eacfe1-82f6-4e32-be7e-692cdd2e53e0 admin admin] Calling method '>' {{(pid=73112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:10:56.186546 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: INFO nova.api.openstack.requestlog [None req-83eacfe1-82f6-4e32-be7e-692cdd2e53e0 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024744 Apr 30 13:10:56.187085 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: [pid: 73112|app: 0|req: 22/45] 10.222.0.79 () {60 vars in 1211 bytes} [Fri Apr 30 13:10:56 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:10:56.196386 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi [None req-732624d9-0cf6-469b-91b6-3934ec18716a admin admin] Calling method '>' {{(pid=73111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:10:56.216349 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: INFO nova.api.openstack.requestlog [None req-732624d9-0cf6-469b-91b6-3934ec18716a admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023482 Apr 30 13:10:56.216891 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: [pid: 73111|app: 0|req: 24/46] 10.222.0.79 () {60 vars in 1211 bytes} [Fri Apr 30 13:10:56 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:10:56.226638 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi [None req-7d7a27e1-4c64-4fad-83bd-3a632eac6ce6 admin admin] Calling method '>' {{(pid=73112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:10:56.238656 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: INFO nova.api.openstack.wsgi [None req-7d7a27e1-4c64-4fad-83bd-3a632eac6ce6 admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 30 13:10:56.239228 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi [None req-7d7a27e1-4c64-4fad-83bd-3a632eac6ce6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=73112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:10:56.240015 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: INFO nova.api.openstack.requestlog [None req-7d7a27e1-4c64-4fad-83bd-3a632eac6ce6 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.017457 Apr 30 13:10:56.240515 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: [pid: 73112|app: 0|req: 23/47] 10.222.0.79 () {60 vars in 1191 bytes} [Fri Apr 30 13:10:56 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 30 13:10:57.548621 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi [None req-732624d9-0cf6-469b-91b6-3934ec18716a admin admin] Calling method '>' {{(pid=73111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:10:57.549651 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: INFO nova.api.openstack.requestlog [None req-732624d9-0cf6-469b-91b6-3934ec18716a admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Apr 30 13:10:57.550082 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: [pid: 73111|app: 0|req: 25/48] 10.222.0.79 () {56 vars in 1075 bytes} [Fri Apr 30 13:10:57 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:10:57.735081 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi [None req-c78985bd-a723-4075-919b-0cce729f71cf admin admin] Calling method '>' {{(pid=73112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:10:57.748224 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: INFO nova.api.openstack.wsgi [None req-c78985bd-a723-4075-919b-0cce729f71cf admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 30 13:10:57.748797 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi [None req-c78985bd-a723-4075-919b-0cce729f71cf admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=73112) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:10:57.749598 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: INFO nova.api.openstack.requestlog [None req-c78985bd-a723-4075-919b-0cce729f71cf admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.064618 Apr 30 13:10:57.750135 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: [pid: 73112|app: 0|req: 24/49] 10.222.0.79 () {60 vars in 1194 bytes} [Fri Apr 30 13:10:57 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 30 13:10:57.759797 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi [None req-453a75c8-72fc-4c66-92a3-20c454bf3ce1 admin admin] Calling method '>' {{(pid=73111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:10:57.779246 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: INFO nova.api.openstack.requestlog [None req-453a75c8-72fc-4c66-92a3-20c454bf3ce1 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.023262 Apr 30 13:10:57.779766 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: [pid: 73111|app: 0|req: 26/50] 10.222.0.79 () {60 vars in 1211 bytes} [Fri Apr 30 13:10:57 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:10:57.789775 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi [None req-ff3aee05-ef99-4c51-ac89-dd0c54122d01 admin admin] Calling method '>' {{(pid=73112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:10:57.810439 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: INFO nova.api.openstack.requestlog [None req-ff3aee05-ef99-4c51-ac89-dd0c54122d01 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024831 Apr 30 13:10:57.810989 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: [pid: 73112|app: 0|req: 25/51] 10.222.0.79 () {60 vars in 1211 bytes} [Fri Apr 30 13:10:57 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:10:57.820276 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi [None req-e1e1a1e8-a92a-4b53-ac34-982bea8b2b73 admin admin] Calling method '>' {{(pid=73111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:10:57.832389 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: INFO nova.api.openstack.wsgi [None req-e1e1a1e8-a92a-4b53-ac34-982bea8b2b73 admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 30 13:10:57.832969 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi [None req-e1e1a1e8-a92a-4b53-ac34-982bea8b2b73 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=73111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:10:57.833768 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: INFO nova.api.openstack.requestlog [None req-e1e1a1e8-a92a-4b53-ac34-982bea8b2b73 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.017086 Apr 30 13:10:57.834323 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: [pid: 73111|app: 0|req: 27/52] 10.222.0.79 () {60 vars in 1194 bytes} [Fri Apr 30 13:10:57 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 30 13:10:59.138461 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi [None req-ff3aee05-ef99-4c51-ac89-dd0c54122d01 admin admin] Calling method '>' {{(pid=73112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:10:59.139476 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: INFO nova.api.openstack.requestlog [None req-ff3aee05-ef99-4c51-ac89-dd0c54122d01 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Apr 30 13:10:59.139873 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: [pid: 73112|app: 0|req: 26/53] 10.222.0.79 () {56 vars in 1075 bytes} [Fri Apr 30 13:10:59 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:10:59.328622 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi [None req-b0cf98c3-e776-47ed-8ac8-f6b84ae80267 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=73111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:10:59.355333 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: INFO nova.api.openstack.requestlog [None req-b0cf98c3-e776-47ed-8ac8-f6b84ae80267 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.078259 Apr 30 13:10:59.355880 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: [pid: 73111|app: 0|req: 28/54] 10.222.0.79 () {64 vars in 1236 bytes} [Fri Apr 30 13:10:59 2021] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:11:00.657173 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi [None req-ff3aee05-ef99-4c51-ac89-dd0c54122d01 admin admin] Calling method '>' {{(pid=73112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:11:00.658226 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: INFO nova.api.openstack.requestlog [None req-ff3aee05-ef99-4c51-ac89-dd0c54122d01 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Apr 30 13:11:00.658665 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: [pid: 73112|app: 0|req: 27/55] 10.222.0.79 () {56 vars in 1075 bytes} [Fri Apr 30 13:11:00 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:11:00.847869 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi [None req-dc5a9974-fe58-4b02-9096-9bd5718dc18e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=73111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:11:00.874161 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: INFO nova.api.openstack.requestlog [None req-dc5a9974-fe58-4b02-9096-9bd5718dc18e admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.077712 Apr 30 13:11:00.874714 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: [pid: 73111|app: 0|req: 29/56] 10.222.0.79 () {64 vars in 1236 bytes} [Fri Apr 30 13:11:00 2021] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:11:02.182323 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi [None req-ff3aee05-ef99-4c51-ac89-dd0c54122d01 admin admin] Calling method '>' {{(pid=73112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:11:02.183321 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: INFO nova.api.openstack.requestlog [None req-ff3aee05-ef99-4c51-ac89-dd0c54122d01 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Apr 30 13:11:02.183716 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: [pid: 73112|app: 0|req: 28/57] 10.222.0.79 () {56 vars in 1075 bytes} [Fri Apr 30 13:11:02 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:11:02.369260 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi [None req-09d43c2e-7423-4eba-8624-a04f96a28277 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=73111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:11:02.394782 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: INFO nova.api.openstack.requestlog [None req-09d43c2e-7423-4eba-8624-a04f96a28277 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.075911 Apr 30 13:11:02.395253 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: [pid: 73111|app: 0|req: 30/58] 10.222.0.79 () {64 vars in 1236 bytes} [Fri Apr 30 13:11:02 2021] POST /compute/v2.1/flavors => generated 407 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:11:03.707361 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi [None req-ff3aee05-ef99-4c51-ac89-dd0c54122d01 admin admin] Calling method '>' {{(pid=73112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:11:03.708360 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: INFO nova.api.openstack.requestlog [None req-ff3aee05-ef99-4c51-ac89-dd0c54122d01 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Apr 30 13:11:03.708756 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: [pid: 73112|app: 0|req: 29/59] 10.222.0.79 () {56 vars in 1075 bytes} [Fri Apr 30 13:11:03 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:11:03.897300 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi [None req-69cbda01-d300-4d55-9cb8-ce458a6e5176 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=73111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:11:03.921441 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: INFO nova.api.openstack.requestlog [None req-69cbda01-d300-4d55-9cb8-ce458a6e5176 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.076088 Apr 30 13:11:03.921984 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: [pid: 73111|app: 0|req: 31/60] 10.222.0.79 () {64 vars in 1236 bytes} [Fri Apr 30 13:11:03 2021] POST /compute/v2.1/flavors => generated 409 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 13:11:05.240989 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi [None req-ff3aee05-ef99-4c51-ac89-dd0c54122d01 admin admin] Calling method '>' {{(pid=73112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:11:05.242084 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: INFO nova.api.openstack.requestlog [None req-ff3aee05-ef99-4c51-ac89-dd0c54122d01 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Apr 30 13:11:05.242508 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: [pid: 73112|app: 0|req: 30/61] 10.222.0.79 () {56 vars in 1075 bytes} [Fri Apr 30 13:11:05 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:11:05.428842 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi [None req-848e7da8-a676-4286-a90c-dc9593f80d20 admin admin] Calling method '>' {{(pid=73111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:11:05.454609 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: INFO nova.api.openstack.requestlog [None req-848e7da8-a676-4286-a90c-dc9593f80d20 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.077302 Apr 30 13:11:05.455087 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: [pid: 73111|app: 0|req: 32/62] 10.222.0.79 () {60 vars in 1203 bytes} [Fri Apr 30 13:11:05 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:11:49.656940 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi [None req-ff3aee05-ef99-4c51-ac89-dd0c54122d01 admin admin] Calling method '>' {{(pid=73112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:11:49.657955 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: INFO nova.api.openstack.requestlog [None req-ff3aee05-ef99-4c51-ac89-dd0c54122d01 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Apr 30 13:11:49.658394 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: [pid: 73112|app: 0|req: 31/63] 10.222.0.79 () {56 vars in 1075 bytes} [Fri Apr 30 13:11:49 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:11:49.853033 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi [None req-4b955b19-6e73-4904-b84a-2d14774be61e admin admin] Calling method '>' {{(pid=73111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:11:49.880780 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: INFO nova.api.openstack.requestlog [None req-4b955b19-6e73-4904-b84a-2d14774be61e admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.080643 Apr 30 13:11:49.881266 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: [pid: 73111|app: 0|req: 33/64] 10.222.0.79 () {60 vars in 1203 bytes} [Fri Apr 30 13:11:49 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:13:05.656142 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi [None req-c85b922e-5b87-4ec4-84f6-5ad4cb9d091b tempest-verify_tempest_config-1650895541 tempest-verify_tempest_config-1650895541-project] Calling method '>' {{(pid=73112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:13:05.658167 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: INFO nova.api.openstack.requestlog [None req-c85b922e-5b87-4ec4-84f6-5ad4cb9d091b tempest-verify_tempest_config-1650895541 tempest-verify_tempest_config-1650895541-project] 10.222.0.79 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.114899 Apr 30 13:13:05.658710 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: [pid: 73112|app: 0|req: 32/65] 10.222.0.79 () {58 vars in 1134 bytes} [Fri Apr 30 13:13:05 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:14:41.907971 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi [None req-4b955b19-6e73-4904-b84a-2d14774be61e admin admin] Calling method '>' {{(pid=73111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:41.908982 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: INFO nova.api.openstack.requestlog [None req-4b955b19-6e73-4904-b84a-2d14774be61e admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Apr 30 13:14:41.909389 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: [pid: 73111|app: 0|req: 34/66] 10.222.0.79 () {56 vars in 1075 bytes} [Fri Apr 30 13:14:41 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:14:42.193703 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi [None req-89517378-e095-42fa-a5bd-5f2e95493253 admin admin] Calling method '>' {{(pid=73112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:42.194936 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:14:42.194936 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: warnings.warn(msg) Apr 30 13:14:42.196482 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG oslo_concurrency.lockutils [None req-89517378-e095-42fa-a5bd-5f2e95493253 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=73112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:42.196925 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG oslo_concurrency.lockutils [None req-89517378-e095-42fa-a5bd-5f2e95493253 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=73112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:42.197713 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG oslo_concurrency.lockutils [None req-89517378-e095-42fa-a5bd-5f2e95493253 admin admin] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=73112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:42.198183 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG oslo_concurrency.lockutils [None req-89517378-e095-42fa-a5bd-5f2e95493253 admin admin] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=73112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:42.230906 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: INFO nova.api.openstack.requestlog [None req-89517378-e095-42fa-a5bd-5f2e95493253 admin admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.170310 Apr 30 13:14:42.231864 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: [pid: 73112|app: 0|req: 33/67] 10.222.0.79 () {60 vars in 1194 bytes} [Fri Apr 30 13:14:42 2021] GET /compute/v2.1/os-services => generated 791 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:14:43.629027 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi [None req-4b955b19-6e73-4904-b84a-2d14774be61e admin admin] Calling method '>' {{(pid=73111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:43.632126 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: INFO nova.api.openstack.requestlog [None req-4b955b19-6e73-4904-b84a-2d14774be61e admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 Apr 30 13:14:43.632126 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: [pid: 73111|app: 0|req: 35/68] 10.222.0.79 () {56 vars in 1075 bytes} [Fri Apr 30 13:14:43 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:14:43.836469 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi [None req-4e140021-8124-4340-8c5d-096ed0d8bd6f admin admin] Calling method '>' {{(pid=73112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:43.838943 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:14:43.838943 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: warnings.warn(msg) Apr 30 13:14:43.839803 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG oslo_concurrency.lockutils [None req-4e140021-8124-4340-8c5d-096ed0d8bd6f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=73112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:43.840219 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG oslo_concurrency.lockutils [None req-4e140021-8124-4340-8c5d-096ed0d8bd6f admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=73112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:43.840765 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG oslo_concurrency.lockutils [None req-4e140021-8124-4340-8c5d-096ed0d8bd6f admin admin] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=73112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:43.841286 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG oslo_concurrency.lockutils [None req-4e140021-8124-4340-8c5d-096ed0d8bd6f admin admin] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=73112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:43.865792 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: INFO nova.api.openstack.requestlog [None req-4e140021-8124-4340-8c5d-096ed0d8bd6f admin admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.094051 Apr 30 13:14:43.866412 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: [pid: 73112|app: 0|req: 34/69] 10.222.0.79 () {60 vars in 1194 bytes} [Fri Apr 30 13:14:43 2021] GET /compute/v2.1/os-services => generated 791 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:14:55.641074 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi [None req-4b955b19-6e73-4904-b84a-2d14774be61e admin admin] Calling method '>' {{(pid=73111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:55.642139 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: INFO nova.api.openstack.requestlog [None req-4b955b19-6e73-4904-b84a-2d14774be61e admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Apr 30 13:14:55.642541 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: [pid: 73111|app: 0|req: 36/70] 10.222.0.79 () {56 vars in 1075 bytes} [Fri Apr 30 13:14:55 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:14:55.837609 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi [None req-4099b427-b046-416f-95d4-4823a8daceef admin admin] Calling method '>' {{(pid=73112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:55.838931 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:14:55.838931 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: warnings.warn(msg) Apr 30 13:14:55.840674 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG oslo_concurrency.lockutils [None req-4099b427-b046-416f-95d4-4823a8daceef admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=73112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:55.841123 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG oslo_concurrency.lockutils [None req-4099b427-b046-416f-95d4-4823a8daceef admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=73112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:55.842077 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG oslo_concurrency.lockutils [None req-4099b427-b046-416f-95d4-4823a8daceef admin admin] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=73112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:55.842414 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG oslo_concurrency.lockutils [None req-4099b427-b046-416f-95d4-4823a8daceef admin admin] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=73112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:55.874538 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: INFO nova.api.openstack.requestlog [None req-4099b427-b046-416f-95d4-4823a8daceef admin admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.090594 Apr 30 13:14:55.875135 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: [pid: 73112|app: 0|req: 35/71] 10.222.0.79 () {60 vars in 1194 bytes} [Fri Apr 30 13:14:55 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:14:57.333946 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: DEBUG nova.api.openstack.wsgi [None req-4b955b19-6e73-4904-b84a-2d14774be61e admin admin] Calling method '>' {{(pid=73111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:57.335017 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: INFO nova.api.openstack.requestlog [None req-4b955b19-6e73-4904-b84a-2d14774be61e admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Apr 30 13:14:57.335416 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: [pid: 73111|app: 0|req: 37/72] 10.222.0.79 () {56 vars in 1075 bytes} [Fri Apr 30 13:14:57 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:14:57.523041 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG nova.api.openstack.wsgi [None req-ba76ff96-a268-433a-947f-f99fc00bacd3 admin admin] Calling method '>' {{(pid=73112) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:14:57.524282 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:14:57.524282 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: warnings.warn(msg) Apr 30 13:14:57.525796 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG oslo_concurrency.lockutils [None req-ba76ff96-a268-433a-947f-f99fc00bacd3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=73112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:57.526270 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG oslo_concurrency.lockutils [None req-ba76ff96-a268-433a-947f-f99fc00bacd3 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=73112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:57.527632 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG oslo_concurrency.lockutils [None req-ba76ff96-a268-433a-947f-f99fc00bacd3 admin admin] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=73112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:14:57.528390 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: DEBUG oslo_concurrency.lockutils [None req-ba76ff96-a268-433a-947f-f99fc00bacd3 admin admin] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=73112) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:14:57.555596 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: INFO nova.api.openstack.requestlog [None req-ba76ff96-a268-433a-947f-f99fc00bacd3 admin admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.082474 Apr 30 13:14:57.555596 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: [pid: 73112|app: 0|req: 36/73] 10.222.0.79 () {60 vars in 1194 bytes} [Fri Apr 30 13:14:57 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:15:54.174173 dv-cinder-788364-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Apr 30 13:15:54.175987 dv-cinder-788364-2-iscsi devstack@n-api.service[73110]: Fri Apr 30 13:15:54 2021 - graceful shutdown triggered... Apr 30 13:15:54.180396 dv-cinder-788364-2-iscsi devstack@n-api.service[73112]: Gracefully killing worker 2 (pid: 73112)... Apr 30 13:15:54.181089 dv-cinder-788364-2-iscsi devstack@n-api.service[73111]: Gracefully killing worker 1 (pid: 73111)... Apr 30 13:15:55.175669 dv-cinder-788364-2-iscsi devstack@n-api.service[73110]: worker 1 buried after 1 seconds Apr 30 13:15:55.175669 dv-cinder-788364-2-iscsi devstack@n-api.service[73110]: worker 2 buried after 1 seconds Apr 30 13:15:55.176043 dv-cinder-788364-2-iscsi devstack@n-api.service[73110]: goodbye to uWSGI. Apr 30 13:15:55.177834 dv-cinder-788364-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Apr 30 13:15:55.180185 dv-cinder-788364-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Apr 30 13:15:55.185171 dv-cinder-788364-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 30 13:15:55.199032 dv-cinder-788364-2-iscsi devstack@n-api.service[87920]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 30 13:15:55.202604 dv-cinder-788364-2-iscsi devstack@n-api.service[87920]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Apr 30 13:15:55 2021] *** Apr 30 13:15:55.202604 dv-cinder-788364-2-iscsi devstack@n-api.service[87920]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 30 13:15:55.202604 dv-cinder-788364-2-iscsi devstack@n-api.service[87920]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 30 13:15:55.202604 dv-cinder-788364-2-iscsi devstack@n-api.service[87920]: nodename: dv-cinder-788364-2-iscsi Apr 30 13:15:55.202604 dv-cinder-788364-2-iscsi devstack@n-api.service[87920]: machine: x86_64 Apr 30 13:15:55.202604 dv-cinder-788364-2-iscsi devstack@n-api.service[87920]: clock source: unix Apr 30 13:15:55.202604 dv-cinder-788364-2-iscsi devstack@n-api.service[87920]: pcre jit disabled Apr 30 13:15:55.202604 dv-cinder-788364-2-iscsi devstack@n-api.service[87920]: detected number of CPU cores: 4 Apr 30 13:15:55.202604 dv-cinder-788364-2-iscsi devstack@n-api.service[87920]: current working directory: / Apr 30 13:15:55.202604 dv-cinder-788364-2-iscsi devstack@n-api.service[87920]: detected binary path: /usr/bin/uwsgi-core Apr 30 13:15:55.203300 dv-cinder-788364-2-iscsi devstack@n-api.service[87920]: your processes number limit is 47680 Apr 30 13:15:55.203300 dv-cinder-788364-2-iscsi devstack@n-api.service[87920]: your memory page size is 4096 bytes Apr 30 13:15:55.203300 dv-cinder-788364-2-iscsi devstack@n-api.service[87920]: detected max file descriptor number: 2048 Apr 30 13:15:55.203300 dv-cinder-788364-2-iscsi devstack@n-api.service[87920]: lock engine: pthread robust mutexes Apr 30 13:15:55.203300 dv-cinder-788364-2-iscsi devstack@n-api.service[87920]: thunder lock: enabled Apr 30 13:15:55.203300 dv-cinder-788364-2-iscsi devstack@n-api.service[87920]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 30 13:15:55.203300 dv-cinder-788364-2-iscsi devstack@n-api.service[87920]: Python version: 3.8.5 (default, Jan 27 2021, 15:41:15) [GCC 9.3.0] Apr 30 13:15:55.246059 dv-cinder-788364-2-iscsi devstack@n-api.service[87920]: Python main interpreter initialized at 0x55feff3f09c0 Apr 30 13:15:55.246059 dv-cinder-788364-2-iscsi devstack@n-api.service[87920]: python threads support enabled Apr 30 13:15:55.246059 dv-cinder-788364-2-iscsi devstack@n-api.service[87920]: your server socket listen backlog is limited to 100 connections Apr 30 13:15:55.246059 dv-cinder-788364-2-iscsi devstack@n-api.service[87920]: your mercy for graceful operations on workers is 90 seconds Apr 30 13:15:55.246474 dv-cinder-788364-2-iscsi devstack@n-api.service[87920]: mapped 403077 bytes (393 KB) for 2 cores Apr 30 13:15:55.246552 dv-cinder-788364-2-iscsi devstack@n-api.service[87920]: *** Operational MODE: preforking *** Apr 30 13:15:55.251873 dv-cinder-788364-2-iscsi devstack@n-api.service[87920]: *** uWSGI is running in multiple interpreter mode *** Apr 30 13:15:55.251873 dv-cinder-788364-2-iscsi devstack@n-api.service[87920]: spawned uWSGI master process (pid: 87920) Apr 30 13:15:55.251873 dv-cinder-788364-2-iscsi devstack@n-api.service[87920]: spawned uWSGI worker 1 (pid: 87932, cores: 1) Apr 30 13:15:55.251873 dv-cinder-788364-2-iscsi devstack@n-api.service[87920]: spawned uWSGI worker 2 (pid: 87933, cores: 1) Apr 30 13:15:55.251873 dv-cinder-788364-2-iscsi devstack@n-api.service[87920]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 30 13:15:55.247748 dv-cinder-788364-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 30 13:15:57.165664 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 30 13:15:57.165664 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: from cryptography.utils import int_from_bytes Apr 30 13:15:57.166613 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 30 13:15:57.166613 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: from cryptography.utils import int_from_bytes Apr 30 13:15:57.226159 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 30 13:15:57.226159 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: from cryptography.utils import int_from_bytes Apr 30 13:15:57.227521 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 30 13:15:57.227521 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: from cryptography.utils import int_from_bytes Apr 30 13:15:59.961305 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 30 13:15:59.962064 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 30 13:15:59.962188 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 30 13:15:59.962552 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 30 13:15:59.962862 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 30 13:15:59.963327 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.963748 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.964126 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.964510 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.965071 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.965242 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.966348 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.966726 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.967114 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.967509 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.967509 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.968325 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-788364-2-iscsi {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.968512 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.968810 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.969132 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.969475 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.969798 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.970162 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.970492 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.971013 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.971476 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.971801 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.972130 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.972492 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.972825 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.973153 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.973490 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.973814 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.974201 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.974527 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.974862 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-788364-2-iscsi {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.975200 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.975529 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.975856 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.976292 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.976619 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.976957 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.977276 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.977614 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.977939 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.978305 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.978641 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.978977 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.979319 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.979651 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.979960 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.980287 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.980628 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.981086 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.981984 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.982295 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.982633 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.983101 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.983558 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.983988 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.984340 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.984739 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.985215 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.985706 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.986330 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.986645 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.987286 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.987584 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.988024 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.988510 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.988972 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.989460 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.990186 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.990489 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.990951 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.991409 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.991895 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.992479 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.992854 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.993311 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.993799 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.994451 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.994919 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.995429 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.995898 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.996360 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.996853 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.997400 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.997972 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.998481 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.998914 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.999302 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:15:59.999753 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.000201 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.000686 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.001137 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.001574 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.002054 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.002510 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.003005 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.003465 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.003940 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.004371 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.004840 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.005289 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.005755 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.006281 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.006764 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.007231 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.007703 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.008190 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.008715 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.009294 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.009873 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.010414 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.010864 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.011333 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.011813 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.012885 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.013353 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.014112 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.014586 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.015095 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.015675 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.016273 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.016764 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.017382 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.017885 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.018400 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.018755 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.019299 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.019838 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.020552 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.021068 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.021453 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.021804 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.022252 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.022525 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.022865 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.023204 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.023531 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.023883 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.024241 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.024597 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.024967 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.025297 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.025655 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.026062 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.026365 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.026700 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.027030 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.027376 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.027713 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.028141 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.028925 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.029445 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.029789 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.030168 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.030503 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.030847 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.031185 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.031517 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.031857 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.032265 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.032613 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.033065 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.033310 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.033652 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.033985 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.034348 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.034804 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.035058 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.035334 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.035670 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.035986 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.036311 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.036646 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.036972 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.037578 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.037975 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.038282 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.038603 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.038927 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.039253 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.039652 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.039890 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.040229 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.040576 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.040900 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.041255 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.041621 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.041906 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.042313 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.042563 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.043006 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.043289 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.043533 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.044058 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.044481 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.044808 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.045152 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.045482 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.046047 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.046474 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.046810 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.047146 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.047479 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.047826 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.048194 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.048483 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.048842 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.049191 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.049514 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.049864 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.050219 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.050556 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.050881 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.051209 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.051532 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.051891 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.052201 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.052562 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.052796 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.053241 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.053615 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.053863 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.054255 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.054704 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.055241 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.055539 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.056052 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.056558 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.057164 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.057504 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.057883 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.058374 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.058822 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.059235 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.059726 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.060216 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.060747 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.061319 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.061759 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.062398 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.062689 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.063091 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.063622 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.064018 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.064640 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.065097 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.065684 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.066055 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.066505 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.066801 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.067169 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.067705 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.067971 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.068311 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.068657 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.068988 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.069541 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.069878 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.070346 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.070796 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.071326 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.071669 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.072220 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.072615 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.072960 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.073604 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.074138 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.074403 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.074756 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.076105 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.076655 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.077050 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.077497 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.077950 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.078355 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.078775 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.079208 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.079608 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.080030 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.080676 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.081077 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.081564 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.081940 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.082555 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.082803 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 30 13:16:00.083996 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 30 13:16:00.084243 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.084243 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.084837 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 30 13:16:00.085067 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.085295 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 30 13:16:00.085295 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 30 13:16:00.085774 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.085774 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.086662 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.086662 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.087198 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.087419 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.087636 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.087908 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.088285 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.088529 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.088529 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.088942 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.089173 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.089386 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.089595 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.089595 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.090047 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.090279 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.090482 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.091406 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.091406 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-788364-2-iscsi {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.091824 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.092024 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.092024 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.092439 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.092788 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.092788 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.093196 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.093405 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.093614 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.094225 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.094225 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.094649 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.094649 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.095240 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.095492 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.095732 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.095942 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.096152 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.096519 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.096740 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.096740 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.097265 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.097484 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.097696 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.097905 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.098152 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.098666 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.098879 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.099102 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.099102 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.099479 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.099694 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.099894 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.100090 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-788364-2-iscsi {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.100290 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.100504 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.100701 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.100900 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.100900 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.101289 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.101662 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.101936 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.102292 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.102541 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.102825 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.102825 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.103424 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.103698 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.103698 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.104600 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.104858 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.105287 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.105546 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.105814 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.106067 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.106362 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.106777 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.106777 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.107207 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.111928 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.112235 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.112610 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.112846 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.113054 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.113444 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.113665 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.113665 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.114130 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.115261 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.115499 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.115961 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.116190 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.116398 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.116398 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.116822 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.117171 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.117396 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.117623 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.117623 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.118227 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.118428 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.118428 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.118819 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.119015 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.119213 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.119426 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.119637 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.119851 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.120065 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.120273 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.120470 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.120693 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.120693 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.121230 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.121230 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.121628 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.121890 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.122284 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.122504 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.122706 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.122916 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.123200 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.123200 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.123819 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.124113 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.124373 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.124650 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.125065 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.125680 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.125680 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.126291 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.126494 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.126701 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.126905 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.127164 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.127523 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.127523 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.127979 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.128324 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.128556 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.128786 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.128959 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.129157 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.129326 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.129481 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.129676 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.129879 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.130256 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.130518 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.130518 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.130942 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.131102 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.131413 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.131576 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.131743 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.131985 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.131985 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.132522 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.132753 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.132753 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.133135 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.133333 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.133520 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.133679 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.133679 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.134239 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.134385 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.134537 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.134732 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.134956 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.135219 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.135370 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.135773 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.135773 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.136270 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.136491 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.136680 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.136911 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.137157 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.137976 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.137976 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.138824 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.139070 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.139298 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.139528 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.139828 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.140081 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.140319 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.140573 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.140573 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.141106 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.141400 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.141793 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.142071 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.142309 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.142728 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.143146 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.143398 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.143398 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.143834 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.143834 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.144508 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.144741 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.144979 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.145244 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.145589 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.145983 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.146256 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.146256 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.146700 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.146849 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.147004 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.147165 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.147165 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.147462 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.147616 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.147762 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.147914 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.148067 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.148220 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.148220 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.148837 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.148997 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.149143 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.149298 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.149298 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.149575 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.149739 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.149885 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.150067 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.150228 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.150373 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.150373 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.150647 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.150871 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.151069 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.151219 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.151219 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.151493 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.151658 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.151658 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 30 13:16:00.152084 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.152237 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.152390 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.152542 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.152542 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.152949 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.153724 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.153724 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.154166 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.154319 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.154589 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.154773 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.154920 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.155065 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.155065 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.155345 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.155505 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.155792 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.156154 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.156154 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.156723 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.156894 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.156894 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.157195 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.157365 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.157365 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.157654 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.157805 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.157966 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.158184 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.158338 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.158509 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.158661 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.159058 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.159058 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.159368 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.159520 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.159520 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.159826 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.159993 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.160154 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.160313 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.160313 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.160611 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.160761 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.160761 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.161066 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.161217 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.161217 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.161513 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.161672 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.161672 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.162129 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.162288 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.162288 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.163057 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.163227 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.163227 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.163540 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.163693 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.163693 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.164028 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.164213 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.164213 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.164518 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.164801 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.164801 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.165149 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.165321 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.165321 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.165618 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.165828 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.165828 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.166760 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.167216 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.167216 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.167742 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.167991 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.168215 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.168412 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.168412 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.168412 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.169804 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.169958 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.169958 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.170441 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.170706 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.170706 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.171181 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.171338 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.171338 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.171642 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.171839 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.172127 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.172413 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.172413 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.172830 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.173115 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.173115 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.173625 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.173842 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.173842 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.174262 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.174433 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.174433 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.174879 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.175259 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.175259 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.175259 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.175979 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.176423 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.176887 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.177118 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.177118 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.177634 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.177885 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.177885 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.178346 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.178520 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.178520 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.178824 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.179053 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.179053 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.179379 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.179791 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.179791 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.180124 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.180278 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.180278 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.180731 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.180980 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.180980 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.181398 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.181610 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.181610 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.181974 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.182226 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.182226 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.182725 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.182996 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.182996 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.183472 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.183759 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.183759 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.184145 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.184418 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.184418 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.185269 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.185567 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.185567 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.185567 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.186221 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.186572 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.186572 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.187148 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.187320 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.187320 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.187762 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.187965 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.187965 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.188265 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.188436 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.188436 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.188791 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.188954 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.189119 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.189270 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.189270 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.189648 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.190018 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.190228 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.190395 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.190568 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.190801 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.190801 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.191275 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.191517 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.191789 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.192055 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.192307 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.192550 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.192914 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.193166 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.193394 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.193718 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.194148 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.194407 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.194580 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.194793 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.194955 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.195130 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.195291 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.195503 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.195789 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.195957 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.196119 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.196279 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.196431 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.196604 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.196604 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.197278 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.197469 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.197798 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.198108 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.198467 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.198642 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.198852 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.199034 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.199188 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.199353 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.199576 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.199748 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.199944 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.200423 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.200648 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.200899 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.201171 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.201372 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.201552 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.201749 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.201903 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.202089 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.202286 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.202506 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.202756 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.203112 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.203275 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.203428 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.203585 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.203796 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.204051 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.204395 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.204665 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.204917 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.205169 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.205674 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.206093 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.206306 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.206466 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.206686 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.206946 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.207448 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.207676 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.208021 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.208223 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.208402 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.208604 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.208850 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.209103 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.209315 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.209520 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.209760 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.210001 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.210632 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.210905 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.211192 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.211447 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.211695 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.211976 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.212294 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.212537 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.212731 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.212898 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.213423 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.213685 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.213880 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.214185 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.214521 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.214733 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.214911 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.215114 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.215314 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.215553 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.215750 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.215906 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.215906 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.216460 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.216631 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.216784 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.216976 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.216976 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.217757 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.217931 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.218111 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.218300 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.218653 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.218862 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.219017 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.219181 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.219342 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.219494 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.219645 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.219842 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.220017 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.220186 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.220345 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.220770 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.220933 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.221094 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.221256 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.221434 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.221600 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.221753 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.221920 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.222095 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.222297 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.222297 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.222612 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.222771 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.222934 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.223116 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.223303 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.223554 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.223718 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.223904 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.224080 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.224267 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.224552 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.224852 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.225062 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.225062 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.225062 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.225062 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.225958 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.226237 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.226625 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.226863 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.226863 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.227357 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.227977 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.228152 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.228432 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.228719 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.229125 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.229125 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.229448 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.229609 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.229770 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.229922 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.230100 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.230472 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.230658 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.231038 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.231038 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.231942 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.231942 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.232280 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.232450 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.232603 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.232603 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.232904 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.233072 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.233224 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.233383 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.233752 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.233915 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.234168 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.234362 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.234519 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.234676 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.234676 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.235256 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.235516 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.235778 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.236094 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.236355 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.236627 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.237024 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.237280 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.237608 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.237881 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.237881 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.238778 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.239051 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.239497 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.239853 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.240119 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.240301 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.240492 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.240735 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.240735 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.241337 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.241496 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.241658 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.241826 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.241826 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.242337 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.242535 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.242744 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.243006 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.243252 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.243503 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.243775 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.244156 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.244156 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.244671 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.244925 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.245335 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.245589 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.245589 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.246044 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.246225 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.246390 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.246550 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.246703 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.247553 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.247553 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.248423 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.248589 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.248589 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.248983 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.249225 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.249225 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.249754 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.250031 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.250031 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.250437 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.250600 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.250600 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.251396 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.251739 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.251930 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.252132 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.252132 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.252447 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.252610 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.252844 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.253059 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.253215 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.253382 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.253382 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.253680 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.253889 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.254295 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.254574 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.254839 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.255087 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.255357 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.255749 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.256014 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.256277 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.256478 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.256645 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.256799 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.257567 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.257743 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.257743 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.258186 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.258572 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.258818 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.258981 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.259145 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.259297 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.259448 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.259600 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.259903 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.260082 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.260234 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.260385 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.260535 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.260535 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.260836 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.261106 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.261272 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.261554 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.261554 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.262023 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.262186 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.262186 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.263094 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.263273 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.263510 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.263723 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.263723 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.264572 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.264743 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.264743 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.265035 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.265202 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.265366 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.265529 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.265529 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.266072 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.266348 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.266612 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.266876 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.266876 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.267270 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.267435 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.267598 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.267752 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.267982 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.268243 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.268243 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.268962 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.269243 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.269243 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.269618 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.269862 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.270399 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.270675 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.270925 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.271332 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.271615 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.271850 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.272313 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.272546 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.272714 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.272881 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.273030 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.273161 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.273362 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.273479 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.273595 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.273717 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.273828 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.273959 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.274086 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.274174 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.274258 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.274340 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.274423 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.274524 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.274624 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.274709 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.274709 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.274881 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.274973 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.275064 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.275064 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.275231 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.275317 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.275408 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.275500 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.275592 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.275677 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.275759 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.275842 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.275927 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.276252 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.276354 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.276440 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.276522 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.276604 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.276696 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.276781 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.276866 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.276946 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.277029 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.277100 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.277180 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.277263 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.277355 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.277455 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.277455 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.277624 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.277714 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.277798 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.277894 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.279334 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.279446 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.279548 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.279548 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.279730 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.279824 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.279908 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.279992 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.280070 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.280148 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.280233 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.280330 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.280415 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.280486 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.280563 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.280635 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.280718 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.280798 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.280877 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.280955 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.281032 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.281103 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.281184 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.281504 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.281598 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.281671 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.281747 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.281911 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.281911 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.282079 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.282163 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.282234 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.282326 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.282410 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.282483 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.282552 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.282630 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.282700 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.282776 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.282859 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.282931 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.282999 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.283068 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.283136 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.283217 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.283297 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.283375 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.283468 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.283559 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.283651 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.283746 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.283746 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.283909 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.283909 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.284058 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.284058 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.284207 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.284280 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.284361 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.284439 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.284529 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.284615 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.284698 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.284788 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.284866 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.285127 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.285225 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.285317 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.285422 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.285515 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.285607 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.285691 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.285774 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.285865 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.285956 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.286069 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.286069 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.286458 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.286590 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.286590 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.286832 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.286914 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.286914 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.287058 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.287151 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.287235 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.287553 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.287553 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.287688 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.287765 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.287765 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.288018 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.288112 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.288184 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.288269 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.288352 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.288448 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.288448 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.288618 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.288703 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.288774 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.288842 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.288842 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.288984 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.289061 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.289131 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.289240 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.289240 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.289637 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.289637 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.289800 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.289800 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.289960 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.290139 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.290240 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.290333 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.290333 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.290483 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.290554 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.290645 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.290724 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.290808 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.290895 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.290895 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.291047 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.291143 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.291228 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.291310 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.291310 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.291487 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.291589 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.291670 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.291741 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.291831 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.291921 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.292005 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.292087 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.292178 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.292262 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.292262 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.292411 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.292493 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.292587 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.292679 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.292762 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.292843 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.292843 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.292992 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.293082 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.293167 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.293248 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.293337 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.293337 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.293480 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.293559 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.293559 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.293842 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.293985 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.294145 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.294241 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.294325 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.294420 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.294554 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.294681 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.294681 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.294855 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.294947 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.295039 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.295351 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.295446 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.295521 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.295600 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=87933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 30 13:16:00.295701 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.295701 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.295701 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.295701 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.295701 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.295701 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.295701 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.295701 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.296230 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.296230 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.296230 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.296230 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.296230 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.296230 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.296230 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.296230 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.297035 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.297035 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.297035 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.297035 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.297035 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.297035 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.297035 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.297035 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.297517 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.297517 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.297517 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.297517 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.297517 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.297517 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.297517 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.297517 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.298111 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.298111 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.298111 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.298111 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.298111 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.298111 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.298111 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.298111 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.298659 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.298659 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.298659 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.298659 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.298659 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.298659 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.298659 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.298659 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.299167 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.299167 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.299167 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.299167 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.299167 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.299167 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.299167 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.299907 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.299907 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.299907 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.299907 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.299907 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.299907 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.299907 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.299907 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.300516 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.300516 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.300516 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.300516 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.300516 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.300516 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.300516 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.300516 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.301011 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.301079 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.301368 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.301721 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.302515 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.302835 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.303538 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.304045 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.304520 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.305368 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.305897 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.306357 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.306729 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.307228 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.307612 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.307987 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.308401 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.308822 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.309896 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.310752 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.311144 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.311519 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.311881 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.312232 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.312568 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.312896 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.313256 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.313590 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.313898 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.314264 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.314593 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.314917 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.315238 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.315571 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.315900 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.316211 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.316544 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.316864 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.317210 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.317530 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.317844 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.318322 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.318513 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.318839 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.319154 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.319482 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.319802 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.320127 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.320450 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.320807 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.321089 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.321414 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.321726 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.322085 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.322417 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.322755 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.323075 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.323393 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.323739 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.324060 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.324396 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.324808 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.325655 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.325965 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.326435 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.326886 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_db.sqlalchemy.engines [None req-4786b3e8-05cb-4b7c-aa0c-1a29b2a14843 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87933) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 13:16:00.327061 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.330817 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.330817 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.330817 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.330817 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.330817 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.330817 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.330817 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.330817 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.332081 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.332081 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.332081 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.332081 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.332081 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.332081 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.332958 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.332958 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.332958 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.333401 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.333557 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.334027 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.334216 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.334467 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.334800 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.335128 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.335454 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.335808 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.336089 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.336457 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.336765 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.337094 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.337509 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.337933 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.338295 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.338631 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.338967 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.339292 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.339636 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.340018 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.340437 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.341012 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.341496 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.342152 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.342832 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.343016 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.343730 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.343870 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.344513 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.344685 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.344992 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.345341 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.345727 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.346391 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.346779 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.347190 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.347582 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.348035 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.348345 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.348865 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.349483 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.349965 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.350742 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.351057 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.351480 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.352124 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.352458 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.352916 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.353476 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.353836 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.354415 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.354865 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.355437 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.355979 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.356560 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.357170 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.357582 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.357945 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.358320 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.358664 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.359000 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.359338 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.359676 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.360010 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.360369 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.360726 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.361060 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.361407 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.361745 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.362156 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.362516 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.362851 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.363220 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.363532 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.363866 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.364192 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.364519 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.364853 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.365184 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.365531 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.365909 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.366255 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.366603 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.367004 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.367294 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.367658 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.368041 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 30 13:16:00.368265 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=87932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 30 13:16:00.405960 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_db.sqlalchemy.engines [None req-c10b6b50-0227-4371-9a26-b4c4d1e3a4a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87932) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 13:16:00.688432 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.context [None req-4786b3e8-05cb-4b7c-aa0c-1a29b2a14843 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c94c5757-8835-44de-a521-d4549117f41a(cell1) {{(pid=87933) load_cells /opt/stack/nova/nova/context.py:464}} Apr 30 13:16:00.693519 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4786b3e8-05cb-4b7c-aa0c-1a29b2a14843 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:00.695656 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4786b3e8-05cb-4b7c-aa0c-1a29b2a14843 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:00.696630 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4786b3e8-05cb-4b7c-aa0c-1a29b2a14843 None None] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:00.699102 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4786b3e8-05cb-4b7c-aa0c-1a29b2a14843 None None] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:00.731947 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_db.sqlalchemy.engines [None req-4786b3e8-05cb-4b7c-aa0c-1a29b2a14843 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87933) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 13:16:00.733362 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_db.sqlalchemy.engines [None req-4786b3e8-05cb-4b7c-aa0c-1a29b2a14843 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87933) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 13:16:00.766715 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.context [None req-c10b6b50-0227-4371-9a26-b4c4d1e3a4a0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c94c5757-8835-44de-a521-d4549117f41a(cell1) {{(pid=87932) load_cells /opt/stack/nova/nova/context.py:464}} Apr 30 13:16:00.770936 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_db.sqlalchemy.engines [None req-4786b3e8-05cb-4b7c-aa0c-1a29b2a14843 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87933) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 13:16:00.771461 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c10b6b50-0227-4371-9a26-b4c4d1e3a4a0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:00.773290 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c10b6b50-0227-4371-9a26-b4c4d1e3a4a0 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:00.774208 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c10b6b50-0227-4371-9a26-b4c4d1e3a4a0 None None] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:00.776385 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c10b6b50-0227-4371-9a26-b4c4d1e3a4a0 None None] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:00.813079 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_db.sqlalchemy.engines [None req-c10b6b50-0227-4371-9a26-b4c4d1e3a4a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87932) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 13:16:00.828952 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_db.sqlalchemy.engines [None req-c10b6b50-0227-4371-9a26-b4c4d1e3a4a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87932) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 13:16:00.874078 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_db.sqlalchemy.engines [None req-c10b6b50-0227-4371-9a26-b4c4d1e3a4a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87932) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 30 13:16:01.222243 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: WARNING keystonemiddleware.auth_token [None req-4786b3e8-05cb-4b7c-aa0c-1a29b2a14843 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 30 13:16:01.225454 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: WARNING keystonemiddleware.auth_token [None req-c10b6b50-0227-4371-9a26-b4c4d1e3a4a0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 30 13:16:01.229194 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: WARNING keystonemiddleware.auth_token [None req-4786b3e8-05cb-4b7c-aa0c-1a29b2a14843 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 30 13:16:01.233887 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: WARNING keystonemiddleware.auth_token [None req-c10b6b50-0227-4371-9a26-b4c4d1e3a4a0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 30 13:16:01.482663 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: WARNING keystonemiddleware.auth_token [None req-c10b6b50-0227-4371-9a26-b4c4d1e3a4a0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 30 13:16:01.490876 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: WARNING keystonemiddleware.auth_token [None req-c10b6b50-0227-4371-9a26-b4c4d1e3a4a0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 30 13:16:01.496052 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55feff3f09c0 pid: 87932 (default app) Apr 30 13:16:01.509018 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: WARNING keystonemiddleware.auth_token [None req-4786b3e8-05cb-4b7c-aa0c-1a29b2a14843 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 30 13:16:01.518389 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: WARNING keystonemiddleware.auth_token [None req-4786b3e8-05cb-4b7c-aa0c-1a29b2a14843 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 30 13:16:01.525802 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55feff3f09c0 pid: 87933 (default app) Apr 30 13:16:37.383608 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-fd2b16ab-7bf3-483a-ba54-b4e79cf67da5 tempest-VolumesSnapshotsTestJSON-323675455 tempest-VolumesSnapshotsTestJSON-323675455-project] Action: 'create', calling method: .version_select at 0x7f75017eeb80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-745325273"}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:16:39.007377 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-59c061e4-9308-4659-b659-35916b46c6b0 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1310473154", "imageRef": "705a0c6b-b003-4687-84bf-8b9f87dae39e", "flavorRef": "452", "networks": [{"uuid": "4f6ff428-220c-464d-bf3c-450653cf4660"}]}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:16:39.076702 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-fd2b16ab-7bf3-483a-ba54-b4e79cf67da5 tempest-VolumesSnapshotsTestJSON-323675455 tempest-VolumesSnapshotsTestJSON-323675455-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.572000 Apr 30 13:16:39.077668 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 1/1] 10.222.0.79 () {60 vars in 1155 bytes} [Fri Apr 30 13:16:35 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 3575 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 30 13:16:39.087182 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-c2400c0d-c683-41fe-89db-a6432f3236f8 tempest-VolumesTestJSON-215176884 tempest-VolumesTestJSON-215176884-project] Calling method '.version_select at 0x7f75015f01f0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:39.376129 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-c2400c0d-c683-41fe-89db-a6432f3236f8 tempest-VolumesTestJSON-215176884 tempest-VolumesTestJSON-215176884-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/8cb89633-464f-4c6f-b9e7-9897d0c65d22" status: 200 len: 351 microversion: 2.1 time: 0.296909 Apr 30 13:16:39.376879 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 2/2] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:16:39 2021] GET /compute/v2.1/os-volumes/8cb89633-464f-4c6f-b9e7-9897d0c65d22 => generated 351 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:16:39.386574 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-bf01df4d-d8cc-4b52-af44-9646b66e97ee tempest-VolumesSnapshotsTestJSON-323675455 tempest-VolumesSnapshotsTestJSON-323675455-project] Calling method '.version_select at 0x7f75015f0af0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:39.628378 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-bf01df4d-d8cc-4b52-af44-9646b66e97ee tempest-VolumesSnapshotsTestJSON-323675455 tempest-VolumesSnapshotsTestJSON-323675455-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/66b6cf75-b017-4a5a-94e9-e3e2098d5008" status: 200 len: 345 microversion: 2.1 time: 0.250128 Apr 30 13:16:39.629227 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 3/3] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:16:39 2021] GET /compute/v2.1/os-volumes/66b6cf75-b017-4a5a-94e9-e3e2098d5008 => generated 345 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:16:39.642901 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-1e7e8f78-9e64-4a4b-98ab-5c3ea32ff625 tempest-VolumesSnapshotsTestJSON-323675455 tempest-VolumesSnapshotsTestJSON-323675455-project] Action: 'create', calling method: .version_select at 0x7f75015f0f70>, body: {"snapshot": {"volume_id": "66b6cf75-b017-4a5a-94e9-e3e2098d5008", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-24263036"}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:16:40.041950 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.network.neutron [None req-59c061e4-9308-4659-b659-35916b46c6b0 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] validate_networks() for [('4f6ff428-220c-464d-bf3c-450653cf4660', None, None, None)] {{(pid=87933) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 13:16:40.142064 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-1e7e8f78-9e64-4a4b-98ab-5c3ea32ff625 tempest-VolumesSnapshotsTestJSON-323675455 tempest-VolumesSnapshotsTestJSON-323675455-project] 10.222.0.79 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 0.504666 Apr 30 13:16:40.142827 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 4/4] 10.222.0.79 () {60 vars in 1162 bytes} [Fri Apr 30 13:16:39 2021] POST /compute/v2.1/os-snapshots => generated 285 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:16:40.154505 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-06baf419-eb9c-4c54-a0fb-820ece914a6d tempest-VolumesSnapshotsTestJSON-323675455 tempest-VolumesSnapshotsTestJSON-323675455-project] Calling method '.version_select at 0x7f750173ac10>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:40.272684 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-06baf419-eb9c-4c54-a0fb-820ece914a6d tempest-VolumesSnapshotsTestJSON-323675455 tempest-VolumesSnapshotsTestJSON-323675455-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/188b1705-ce09-4e4f-88af-343f13099d24" status: 200 len: 285 microversion: 2.1 time: 0.123135 Apr 30 13:16:40.273554 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 5/5] 10.222.0.79 () {58 vars in 1251 bytes} [Fri Apr 30 13:16:40 2021] GET /compute/v2.1/os-snapshots/188b1705-ce09-4e4f-88af-343f13099d24 => generated 285 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:16:40.287307 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-eb15b2bf-35f3-488f-9ee2-1e7ec710ef04 tempest-VolumesSnapshotsTestJSON-323675455 tempest-VolumesSnapshotsTestJSON-323675455-project] Calling method '.version_select at 0x7f75015878b0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:40.390376 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-eb15b2bf-35f3-488f-9ee2-1e7ec710ef04 tempest-VolumesSnapshotsTestJSON-323675455 tempest-VolumesSnapshotsTestJSON-323675455-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.107979 Apr 30 13:16:40.416170 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 6/6] 10.222.0.79 () {58 vars in 1140 bytes} [Fri Apr 30 13:16:40 2021] GET /compute/v2.1/os-snapshots => generated 288 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:16:40.428858 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-d9a002ed-3669-4d30-b6ff-f9a8db45e254 tempest-VolumesSnapshotsTestJSON-323675455 tempest-VolumesSnapshotsTestJSON-323675455-project] Calling method '.version_select at 0x7f7501587f70>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:40.504251 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-d9a002ed-3669-4d30-b6ff-f9a8db45e254 tempest-VolumesSnapshotsTestJSON-323675455 tempest-VolumesSnapshotsTestJSON-323675455-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/188b1705-ce09-4e4f-88af-343f13099d24" status: 200 len: 285 microversion: 2.1 time: 0.085264 Apr 30 13:16:40.510536 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 7/7] 10.222.0.79 () {58 vars in 1251 bytes} [Fri Apr 30 13:16:40 2021] GET /compute/v2.1/os-snapshots/188b1705-ce09-4e4f-88af-343f13099d24 => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:16:41.611186 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-c6858d29-47d1-4c0a-85b9-9aed858e68a9 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-343951445", "imageRef": "705a0c6b-b003-4687-84bf-8b9f87dae39e", "flavorRef": "452", "networks": [{"uuid": "7a957d0c-5ad1-4932-ac78-e964afd71e05"}]}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:16:41.867955 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.network.neutron [None req-c6858d29-47d1-4c0a-85b9-9aed858e68a9 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] validate_networks() for [('7a957d0c-5ad1-4932-ac78-e964afd71e05', None, None, None)] {{(pid=87932) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 13:16:42.305913 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.virt.hardware [None req-59c061e4-9308-4659-b659-35916b46c6b0 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Flavor limits 0:0:0 {{(pid=87933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 13:16:42.306999 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.virt.hardware [None req-59c061e4-9308-4659-b659-35916b46c6b0 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Image limits 0:0:0 {{(pid=87933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 13:16:42.308395 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.virt.hardware [None req-59c061e4-9308-4659-b659-35916b46c6b0 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Flavor pref 0:0:0 {{(pid=87933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 13:16:42.309327 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.virt.hardware [None req-59c061e4-9308-4659-b659-35916b46c6b0 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Image pref 0:0:0 {{(pid=87933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 13:16:42.309769 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.virt.hardware [None req-59c061e4-9308-4659-b659-35916b46c6b0 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 13:16:42.325763 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-59c061e4-9308-4659-b659-35916b46c6b0 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:42.326467 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-59c061e4-9308-4659-b659-35916b46c6b0 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:42.327830 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-59c061e4-9308-4659-b659-35916b46c6b0 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:42.328414 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-59c061e4-9308-4659-b659-35916b46c6b0 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:42.374042 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.quota [None req-59c061e4-9308-4659-b659-35916b46c6b0 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Getting quotas for project f8dcaa02d735401891147a4c2464e318. Resources: {'ram', 'instances', 'cores'} {{(pid=87933) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:16:42.384357 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.quota [None req-59c061e4-9308-4659-b659-35916b46c6b0 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Getting quotas for user f2a53be36b2d4d6681dacffb5843510f and project f8dcaa02d735401891147a4c2464e318. Resources: {'ram', 'instances', 'cores'} {{(pid=87933) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:16:42.412650 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-59c061e4-9308-4659-b659-35916b46c6b0 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Going to run 1 instances... {{(pid=87933) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 13:16:42.431205 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-59c061e4-9308-4659-b659-35916b46c6b0 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: d94a56dc-cb9d-4b55-9f89-b121d45230ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='705a0c6b-b003-4687-84bf-8b9f87dae39e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=87933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 13:16:42.657637 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-59c061e4-9308-4659-b659-35916b46c6b0 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.419318 Apr 30 13:16:42.659019 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 1/8] 10.222.0.79 () {60 vars in 1147 bytes} [Fri Apr 30 13:16:38 2021] POST /compute/v2.1/servers => generated 380 bytes in 4422 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 13:16:42.664806 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-f1706a0b-395a-4595-9493-f46da7af18a4 tempest-VolumesSnapshotsTestJSON-323675455 tempest-VolumesSnapshotsTestJSON-323675455-project] Calling method '.version_select at 0x7f750155edc0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:42.827284 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-f1706a0b-395a-4595-9493-f46da7af18a4 tempest-VolumesSnapshotsTestJSON-323675455 tempest-VolumesSnapshotsTestJSON-323675455-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/188b1705-ce09-4e4f-88af-343f13099d24" status: 200 len: 285 microversion: 2.1 time: 0.166659 Apr 30 13:16:42.830576 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 2/9] 10.222.0.79 () {58 vars in 1251 bytes} [Fri Apr 30 13:16:42 2021] GET /compute/v2.1/os-snapshots/188b1705-ce09-4e4f-88af-343f13099d24 => generated 285 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:16:42.837266 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b3b441a9-15ed-419a-bac8-1e71fe9576fd tempest-VolumesTestJSON-215176884 tempest-VolumesTestJSON-215176884-project] Calling method '.version_select at 0x7f750156daf0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:43.117201 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b3b441a9-15ed-419a-bac8-1e71fe9576fd tempest-VolumesTestJSON-215176884 tempest-VolumesTestJSON-215176884-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/3ae8f6da-532e-4a0c-b634-bc5b1cfb1e2e" status: 200 len: 351 microversion: 2.1 time: 0.283783 Apr 30 13:16:43.117844 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 3/10] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:16:42 2021] GET /compute/v2.1/os-volumes/3ae8f6da-532e-4a0c-b634-bc5b1cfb1e2e => generated 351 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:16:43.123988 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-7c423ef2-03a1-40a1-876c-8648939479b2 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:43.124680 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-7c423ef2-03a1-40a1-876c-8648939479b2 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: d94a56dc-cb9d-4b55-9f89-b121d45230ca] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:43.757391 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-7c423ef2-03a1-40a1-876c-8648939479b2 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:43.789584 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-7c423ef2-03a1-40a1-876c-8648939479b2 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca" status: 200 len: 1218 microversion: 2.1 time: 0.669868 Apr 30 13:16:43.793036 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 4/11] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:16:43 2021] GET /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca => generated 1218 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:43.843413 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b4380d5e-11f8-4e29-9010-08e8e372d771 tempest-VolumesSnapshotsTestJSON-323675455 tempest-VolumesSnapshotsTestJSON-323675455-project] Calling method '.version_select at 0x7f7500cde550>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:44.170175 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b4380d5e-11f8-4e29-9010-08e8e372d771 tempest-VolumesSnapshotsTestJSON-323675455 tempest-VolumesSnapshotsTestJSON-323675455-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/188b1705-ce09-4e4f-88af-343f13099d24" status: 200 len: 285 microversion: 2.1 time: 0.332062 Apr 30 13:16:44.171232 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 5/12] 10.222.0.79 () {58 vars in 1251 bytes} [Fri Apr 30 13:16:43 2021] GET /compute/v2.1/os-snapshots/188b1705-ce09-4e4f-88af-343f13099d24 => generated 285 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:16:44.814962 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-a3ab9c46-3308-4aa2-b485-3a523ca82024 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:44.824096 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-a3ab9c46-3308-4aa2-b485-3a523ca82024 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: d94a56dc-cb9d-4b55-9f89-b121d45230ca] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:45.109119 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-a3ab9c46-3308-4aa2-b485-3a523ca82024 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:45.124682 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-a3ab9c46-3308-4aa2-b485-3a523ca82024 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca" status: 200 len: 1218 microversion: 2.1 time: 0.318877 Apr 30 13:16:45.134152 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 6/13] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:16:44 2021] GET /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca => generated 1218 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:45.187196 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-5e94231b-b430-41e2-a95e-4ca339f55387 tempest-VolumesSnapshotsTestJSON-323675455 tempest-VolumesSnapshotsTestJSON-323675455-project] Calling method '.version_select at 0x7f7500ce7f70>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:45.309682 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-5e94231b-b430-41e2-a95e-4ca339f55387 tempest-VolumesSnapshotsTestJSON-323675455 tempest-VolumesSnapshotsTestJSON-323675455-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/188b1705-ce09-4e4f-88af-343f13099d24" status: 200 len: 286 microversion: 2.1 time: 0.127101 Apr 30 13:16:45.311731 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 7/14] 10.222.0.79 () {58 vars in 1251 bytes} [Fri Apr 30 13:16:45 2021] GET /compute/v2.1/os-snapshots/188b1705-ce09-4e4f-88af-343f13099d24 => generated 286 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:16:45.323502 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-3e28b45c-d637-4925-bfe8-861a864ea226 tempest-VolumesSnapshotsTestJSON-323675455 tempest-VolumesSnapshotsTestJSON-323675455-project] Calling method '.version_select at 0x7f750156daf0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:45.495770 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-3e28b45c-d637-4925-bfe8-861a864ea226 tempest-VolumesSnapshotsTestJSON-323675455 tempest-VolumesSnapshotsTestJSON-323675455-project] 10.222.0.79 "DELETE /compute/v2.1/os-snapshots/188b1705-ce09-4e4f-88af-343f13099d24" status: 202 len: 0 microversion: 2.1 time: 0.176985 Apr 30 13:16:45.497280 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 8/15] 10.222.0.79 () {58 vars in 1254 bytes} [Fri Apr 30 13:16:45 2021] DELETE /compute/v2.1/os-snapshots/188b1705-ce09-4e4f-88af-343f13099d24 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:16:45.504304 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-e202515d-7379-4712-b6fc-c7885a733d7c tempest-VolumesTestJSON-215176884 tempest-VolumesTestJSON-215176884-project] Calling method '.version_select at 0x7f7500cde820>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:45.727667 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-e202515d-7379-4712-b6fc-c7885a733d7c tempest-VolumesTestJSON-215176884 tempest-VolumesTestJSON-215176884-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/c26bd8fd-1b3a-4ea8-bfe7-057b1412907a" status: 200 len: 351 microversion: 2.1 time: 0.227729 Apr 30 13:16:45.728854 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 9/16] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:16:45 2021] GET /compute/v2.1/os-volumes/c26bd8fd-1b3a-4ea8-bfe7-057b1412907a => generated 351 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:16:45.740508 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-88abc3fe-d2a1-441b-ad61-d825db2b8f1e tempest-VolumesSnapshotsTestJSON-323675455 tempest-VolumesSnapshotsTestJSON-323675455-project] Calling method '.version_select at 0x7f750163b790>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:45.900888 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-88abc3fe-d2a1-441b-ad61-d825db2b8f1e tempest-VolumesSnapshotsTestJSON-323675455 tempest-VolumesSnapshotsTestJSON-323675455-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/188b1705-ce09-4e4f-88af-343f13099d24" status: 200 len: 285 microversion: 2.1 time: 0.170162 Apr 30 13:16:45.902788 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 10/17] 10.222.0.79 () {58 vars in 1251 bytes} [Fri Apr 30 13:16:45 2021] GET /compute/v2.1/os-snapshots/188b1705-ce09-4e4f-88af-343f13099d24 => generated 285 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:16:45.912280 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-baec91a5-b6a4-4ba7-bd5b-cdb6798298d2 tempest-VolumesTestJSON-215176884 tempest-VolumesTestJSON-215176884-project] Calling method '.version_select at 0x7f7500cde1f0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:46.140796 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-baec91a5-b6a4-4ba7-bd5b-cdb6798298d2 tempest-VolumesTestJSON-215176884 tempest-VolumesTestJSON-215176884-project] 10.222.0.79 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.236638 Apr 30 13:16:46.141707 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 11/18] 10.222.0.79 () {58 vars in 1134 bytes} [Fri Apr 30 13:16:45 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:46.146613 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-90703e8d-91b0-40a0-b522-abc50ca0caef tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:46.147693 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-90703e8d-91b0-40a0-b522-abc50ca0caef tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: d94a56dc-cb9d-4b55-9f89-b121d45230ca] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:46.158317 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-90703e8d-91b0-40a0-b522-abc50ca0caef tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:46.159038 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-90703e8d-91b0-40a0-b522-abc50ca0caef tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:46.160073 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-90703e8d-91b0-40a0-b522-abc50ca0caef tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:46.161059 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-90703e8d-91b0-40a0-b522-abc50ca0caef tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:46.229982 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-c6858d29-47d1-4c0a-85b9-9aed858e68a9 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Flavor limits 0:0:0 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 13:16:46.231524 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-c6858d29-47d1-4c0a-85b9-9aed858e68a9 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Image limits 0:0:0 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 13:16:46.232412 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-c6858d29-47d1-4c0a-85b9-9aed858e68a9 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Flavor pref 0:0:0 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 13:16:46.237135 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-c6858d29-47d1-4c0a-85b9-9aed858e68a9 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Image pref 0:0:0 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 13:16:46.237822 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-c6858d29-47d1-4c0a-85b9-9aed858e68a9 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 13:16:46.263976 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c6858d29-47d1-4c0a-85b9-9aed858e68a9 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:46.266596 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c6858d29-47d1-4c0a-85b9-9aed858e68a9 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:46.267880 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c6858d29-47d1-4c0a-85b9-9aed858e68a9 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:46.274091 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c6858d29-47d1-4c0a-85b9-9aed858e68a9 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:46.351441 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.quota [None req-c6858d29-47d1-4c0a-85b9-9aed858e68a9 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Getting quotas for project 799dda396dc145d58b214518705a9227. Resources: {'ram', 'instances', 'cores'} {{(pid=87932) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:16:46.369692 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.quota [None req-c6858d29-47d1-4c0a-85b9-9aed858e68a9 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Getting quotas for user ab7d9d559fcc4228a382dc23989d601e and project 799dda396dc145d58b214518705a9227. Resources: {'ram', 'instances', 'cores'} {{(pid=87932) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:16:46.420676 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-c6858d29-47d1-4c0a-85b9-9aed858e68a9 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Going to run 1 instances... {{(pid=87932) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 13:16:46.427013 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-c6858d29-47d1-4c0a-85b9-9aed858e68a9 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] [instance: 272025ed-c9af-4c21-8df7-b4ebc88b96cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='705a0c6b-b003-4687-84bf-8b9f87dae39e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=87932) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 13:16:46.599587 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-90703e8d-91b0-40a0-b522-abc50ca0caef tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:46.638763 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-90703e8d-91b0-40a0-b522-abc50ca0caef tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca" status: 200 len: 1270 microversion: 2.1 time: 0.495716 Apr 30 13:16:46.641231 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 12/19] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:16:46 2021] GET /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca => generated 1270 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:46.653505 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-27a4de93-5bc9-442b-a4ae-cf9c3d81faea tempest-VolumesTestJSON-215176884 tempest-VolumesTestJSON-215176884-project] Calling method '.version_select at 0x7f7500c6f430>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:46.664939 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-c6858d29-47d1-4c0a-85b9-9aed858e68a9 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.202754 Apr 30 13:16:46.672440 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 8/20] 10.222.0.79 () {60 vars in 1147 bytes} [Fri Apr 30 13:16:41 2021] POST /compute/v2.1/servers => generated 380 bytes in 5211 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 30 13:16:46.691143 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-13477979-18cf-4ef9-ab09-a543078e1ba5 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:46.691999 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-13477979-18cf-4ef9-ab09-a543078e1ba5 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] [instance: 272025ed-c9af-4c21-8df7-b4ebc88b96cd] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:46.981040 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-27a4de93-5bc9-442b-a4ae-cf9c3d81faea tempest-VolumesTestJSON-215176884 tempest-VolumesTestJSON-215176884-project] 10.222.0.79 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.337915 Apr 30 13:16:46.982417 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 13/21] 10.222.0.79 () {58 vars in 1149 bytes} [Fri Apr 30 13:16:46 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:16:47.004106 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-9da11c66-a55f-42a4-92b4-7ba2c462c3fc tempest-VolumesSnapshotsTestJSON-323675455 tempest-VolumesSnapshotsTestJSON-323675455-project] Calling method '.version_select at 0x7f7500c783a0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:47.022511 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-13477979-18cf-4ef9-ab09-a543078e1ba5 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7d9d559fcc4228a382dc23989d601e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dda396dc145d58b214518705a9227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:47.052198 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-13477979-18cf-4ef9-ab09-a543078e1ba5 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] 10.222.0.79 "GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd" status: 200 len: 1214 microversion: 2.1 time: 0.378028 Apr 30 13:16:47.066461 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 9/22] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:16:46 2021] GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd => generated 1214 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:47.076193 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-84fb0dda-6630-400a-8d84-87c7d938604b tempest-VolumesTestJSON-215176884 tempest-VolumesTestJSON-215176884-project] Calling method '.version_select at 0x7f75014e33a0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:47.114705 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.wsgi [None req-9da11c66-a55f-42a4-92b4-7ba2c462c3fc tempest-VolumesSnapshotsTestJSON-323675455 tempest-VolumesSnapshotsTestJSON-323675455-project] HTTP exception thrown: Snapshot 188b1705-ce09-4e4f-88af-343f13099d24 could not be found. Apr 30 13:16:47.115408 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-9da11c66-a55f-42a4-92b4-7ba2c462c3fc tempest-VolumesSnapshotsTestJSON-323675455 tempest-VolumesSnapshotsTestJSON-323675455-project] Returning 404 to user: Snapshot 188b1705-ce09-4e4f-88af-343f13099d24 could not be found. {{(pid=87933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:16:47.116356 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-9da11c66-a55f-42a4-92b4-7ba2c462c3fc tempest-VolumesSnapshotsTestJSON-323675455 tempest-VolumesSnapshotsTestJSON-323675455-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/188b1705-ce09-4e4f-88af-343f13099d24" status: 404 len: 111 microversion: 2.1 time: 0.117363 Apr 30 13:16:47.118043 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 14/23] 10.222.0.79 () {58 vars in 1251 bytes} [Fri Apr 30 13:16:46 2021] GET /compute/v2.1/os-snapshots/188b1705-ce09-4e4f-88af-343f13099d24 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:16:47.129881 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-28a4e9d8-d71e-4e8f-81a0-98ca1cfc219a tempest-VolumesSnapshotsTestJSON-323675455 tempest-VolumesSnapshotsTestJSON-323675455-project] Calling method '.version_select at 0x7f7500c6faf0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:47.416443 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-28a4e9d8-d71e-4e8f-81a0-98ca1cfc219a tempest-VolumesSnapshotsTestJSON-323675455 tempest-VolumesSnapshotsTestJSON-323675455-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/66b6cf75-b017-4a5a-94e9-e3e2098d5008" status: 202 len: 0 microversion: 2.1 time: 0.291973 Apr 30 13:16:47.418884 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 15/24] 10.222.0.79 () {58 vars in 1248 bytes} [Fri Apr 30 13:16:47 2021] DELETE /compute/v2.1/os-volumes/66b6cf75-b017-4a5a-94e9-e3e2098d5008 => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:16:47.431885 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-8de1fdc3-5c2f-4290-a7f9-3a9515bf4cd2 tempest-VolumesSnapshotsTestJSON-323675455 tempest-VolumesSnapshotsTestJSON-323675455-project] Calling method '.version_select at 0x7f7500c6fd30>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:47.544637 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-84fb0dda-6630-400a-8d84-87c7d938604b tempest-VolumesTestJSON-215176884 tempest-VolumesTestJSON-215176884-project] 10.222.0.79 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.476551 Apr 30 13:16:47.545412 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 10/25] 10.222.0.79 () {58 vars in 1134 bytes} [Fri Apr 30 13:16:47 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:47.561452 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-176b6bf2-924e-4c8a-8fb9-2f8249fef4e9 tempest-VolumesTestJSON-215176884 tempest-VolumesTestJSON-215176884-project] Calling method '.version_select at 0x7f75014ee790>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:47.743254 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-176b6bf2-924e-4c8a-8fb9-2f8249fef4e9 tempest-VolumesTestJSON-215176884 tempest-VolumesTestJSON-215176884-project] 10.222.0.79 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.185943 Apr 30 13:16:47.744020 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 11/26] 10.222.0.79 () {58 vars in 1167 bytes} [Fri Apr 30 13:16:47 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:16:47.771709 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-83527aab-c5ab-47ef-8854-0a7a2d1835bc tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:47.785886 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-8de1fdc3-5c2f-4290-a7f9-3a9515bf4cd2 tempest-VolumesSnapshotsTestJSON-323675455 tempest-VolumesSnapshotsTestJSON-323675455-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/66b6cf75-b017-4a5a-94e9-e3e2098d5008" status: 200 len: 344 microversion: 2.1 time: 0.360842 Apr 30 13:16:47.787741 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 16/27] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:16:47 2021] GET /compute/v2.1/os-volumes/66b6cf75-b017-4a5a-94e9-e3e2098d5008 => generated 344 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:16:47.795291 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-ce41fe3c-e675-4c4d-b53e-be970b0215b4 tempest-VolumesTestJSON-215176884 tempest-VolumesTestJSON-215176884-project] Calling method '.version_select at 0x7f7500c6f940>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:47.797018 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-83527aab-c5ab-47ef-8854-0a7a2d1835bc tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: d94a56dc-cb9d-4b55-9f89-b121d45230ca] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:47.836007 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-83527aab-c5ab-47ef-8854-0a7a2d1835bc tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:47.839556 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-83527aab-c5ab-47ef-8854-0a7a2d1835bc tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:47.841333 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-83527aab-c5ab-47ef-8854-0a7a2d1835bc tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:47.843780 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-83527aab-c5ab-47ef-8854-0a7a2d1835bc tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:48.084338 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-ce41fe3c-e675-4c4d-b53e-be970b0215b4 tempest-VolumesTestJSON-215176884 tempest-VolumesTestJSON-215176884-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.295249 Apr 30 13:16:48.087353 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 17/28] 10.222.0.79 () {58 vars in 1170 bytes} [Fri Apr 30 13:16:47 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:16:48.099722 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-9d4554fb-6978-40bd-9c35-6ddbf32252dc tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:48.103076 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-9d4554fb-6978-40bd-9c35-6ddbf32252dc tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] [instance: 272025ed-c9af-4c21-8df7-b4ebc88b96cd] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:48.336437 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-9d4554fb-6978-40bd-9c35-6ddbf32252dc tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7d9d559fcc4228a382dc23989d601e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dda396dc145d58b214518705a9227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:48.363503 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-9d4554fb-6978-40bd-9c35-6ddbf32252dc tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] 10.222.0.79 "GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd" status: 200 len: 1214 microversion: 2.1 time: 0.271172 Apr 30 13:16:48.366642 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 18/29] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:16:48 2021] GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd => generated 1214 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:48.375040 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-e2b6686b-c4f8-4f6a-9be6-a52218baa575 tempest-VolumesTestJSON-215176884 tempest-VolumesTestJSON-215176884-project] Calling method '.version_select at 0x7f7500c6f280>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:48.498121 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-83527aab-c5ab-47ef-8854-0a7a2d1835bc tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:48.527247 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-83527aab-c5ab-47ef-8854-0a7a2d1835bc tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca" status: 200 len: 1276 microversion: 2.1 time: 0.764769 Apr 30 13:16:48.533228 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 12/30] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:16:47 2021] GET /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca => generated 1276 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:48.624410 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-e2b6686b-c4f8-4f6a-9be6-a52218baa575 tempest-VolumesTestJSON-215176884 tempest-VolumesTestJSON-215176884-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.256591 Apr 30 13:16:48.625689 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 19/31] 10.222.0.79 () {58 vars in 1155 bytes} [Fri Apr 30 13:16:48 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:48.638573 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-7fd075f4-a0fa-4f5a-9fa6-db67205a6472 tempest-VolumesTestJSON-215176884 tempest-VolumesTestJSON-215176884-project] Calling method '.version_select at 0x7f7500c793a0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:48.799932 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-71071bb0-3554-4925-929e-cd2af5593b84 tempest-VolumesSnapshotsTestJSON-323675455 tempest-VolumesSnapshotsTestJSON-323675455-project] Calling method '.version_select at 0x7f7500c781f0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:48.887141 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-7fd075f4-a0fa-4f5a-9fa6-db67205a6472 tempest-VolumesTestJSON-215176884 tempest-VolumesTestJSON-215176884-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.254153 Apr 30 13:16:48.894859 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 13/32] 10.222.0.79 () {58 vars in 1188 bytes} [Fri Apr 30 13:16:48 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:16:48.899599 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-e8c515f9-491f-4e36-bcb6-bbd9eb0957a6 tempest-VolumesTestJSON-215176884 tempest-VolumesTestJSON-215176884-project] Calling method '.version_select at 0x7f7500bff280>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:48.980591 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.wsgi [None req-71071bb0-3554-4925-929e-cd2af5593b84 tempest-VolumesSnapshotsTestJSON-323675455 tempest-VolumesSnapshotsTestJSON-323675455-project] HTTP exception thrown: Volume 66b6cf75-b017-4a5a-94e9-e3e2098d5008 could not be found. Apr 30 13:16:48.981406 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-71071bb0-3554-4925-929e-cd2af5593b84 tempest-VolumesSnapshotsTestJSON-323675455 tempest-VolumesSnapshotsTestJSON-323675455-project] Returning 404 to user: Volume 66b6cf75-b017-4a5a-94e9-e3e2098d5008 could not be found. {{(pid=87933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:16:48.982451 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-71071bb0-3554-4925-929e-cd2af5593b84 tempest-VolumesSnapshotsTestJSON-323675455 tempest-VolumesSnapshotsTestJSON-323675455-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/66b6cf75-b017-4a5a-94e9-e3e2098d5008" status: 404 len: 109 microversion: 2.1 time: 0.186326 Apr 30 13:16:48.991979 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 20/33] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:16:48 2021] GET /compute/v2.1/os-volumes/66b6cf75-b017-4a5a-94e9-e3e2098d5008 => generated 109 bytes in 197 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 13:16:48.998615 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b090e50f-ccd6-4401-b960-1fba7eb8da2a tempest-VolumesSnapshotsTestJSON-323675455 tempest-VolumesSnapshotsTestJSON-323675455-project] Calling method '.version_select at 0x7f7500cf2550>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:49.118353 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.wsgi [None req-b090e50f-ccd6-4401-b960-1fba7eb8da2a tempest-VolumesSnapshotsTestJSON-323675455 tempest-VolumesSnapshotsTestJSON-323675455-project] HTTP exception thrown: Volume 66b6cf75-b017-4a5a-94e9-e3e2098d5008 could not be found. Apr 30 13:16:49.119024 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b090e50f-ccd6-4401-b960-1fba7eb8da2a tempest-VolumesSnapshotsTestJSON-323675455 tempest-VolumesSnapshotsTestJSON-323675455-project] Returning 404 to user: Volume 66b6cf75-b017-4a5a-94e9-e3e2098d5008 could not be found. {{(pid=87933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:16:49.119803 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b090e50f-ccd6-4401-b960-1fba7eb8da2a tempest-VolumesSnapshotsTestJSON-323675455 tempest-VolumesSnapshotsTestJSON-323675455-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/66b6cf75-b017-4a5a-94e9-e3e2098d5008" status: 404 len: 109 microversion: 2.1 time: 0.126793 Apr 30 13:16:49.120853 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 21/34] 10.222.0.79 () {58 vars in 1248 bytes} [Fri Apr 30 13:16:48 2021] DELETE /compute/v2.1/os-volumes/66b6cf75-b017-4a5a-94e9-e3e2098d5008 => generated 109 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:16:49.129239 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-5c6c99a8-7b4c-4803-9802-04ba815fefd4 tempest-VolumesSnapshotsTestJSON-323675455 tempest-VolumesSnapshotsTestJSON-323675455-project] Calling method '.version_select at 0x7f7500c78820>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:49.189259 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-e8c515f9-491f-4e36-bcb6-bbd9eb0957a6 tempest-VolumesTestJSON-215176884 tempest-VolumesTestJSON-215176884-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.293199 Apr 30 13:16:49.201624 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 14/35] 10.222.0.79 () {58 vars in 1155 bytes} [Fri Apr 30 13:16:48 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:49.331044 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.wsgi [None req-5c6c99a8-7b4c-4803-9802-04ba815fefd4 tempest-VolumesSnapshotsTestJSON-323675455 tempest-VolumesSnapshotsTestJSON-323675455-project] HTTP exception thrown: Volume 66b6cf75-b017-4a5a-94e9-e3e2098d5008 could not be found. Apr 30 13:16:49.332573 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-5c6c99a8-7b4c-4803-9802-04ba815fefd4 tempest-VolumesSnapshotsTestJSON-323675455 tempest-VolumesSnapshotsTestJSON-323675455-project] Returning 404 to user: Volume 66b6cf75-b017-4a5a-94e9-e3e2098d5008 could not be found. {{(pid=87933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:16:49.334033 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-5c6c99a8-7b4c-4803-9802-04ba815fefd4 tempest-VolumesSnapshotsTestJSON-323675455 tempest-VolumesSnapshotsTestJSON-323675455-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/66b6cf75-b017-4a5a-94e9-e3e2098d5008" status: 404 len: 109 microversion: 2.1 time: 0.208557 Apr 30 13:16:49.338095 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 22/36] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:16:49 2021] GET /compute/v2.1/os-volumes/66b6cf75-b017-4a5a-94e9-e3e2098d5008 => generated 109 bytes in 210 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 13:16:49.403657 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-8cede71d-21bb-40b6-9bb8-a10830d53513 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:49.410710 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-8cede71d-21bb-40b6-9bb8-a10830d53513 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] [instance: 272025ed-c9af-4c21-8df7-b4ebc88b96cd] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:49.431482 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8cede71d-21bb-40b6-9bb8-a10830d53513 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:49.431956 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8cede71d-21bb-40b6-9bb8-a10830d53513 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:49.433310 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8cede71d-21bb-40b6-9bb8-a10830d53513 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:49.433856 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8cede71d-21bb-40b6-9bb8-a10830d53513 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:49.550286 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-ee42f2c4-b6fd-49b1-9cc6-a42f581044db tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:49.550919 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-ee42f2c4-b6fd-49b1-9cc6-a42f581044db tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: d94a56dc-cb9d-4b55-9f89-b121d45230ca] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:49.567710 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ee42f2c4-b6fd-49b1-9cc6-a42f581044db tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:49.568175 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ee42f2c4-b6fd-49b1-9cc6-a42f581044db tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:49.568996 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ee42f2c4-b6fd-49b1-9cc6-a42f581044db tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:49.569445 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ee42f2c4-b6fd-49b1-9cc6-a42f581044db tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:50.445041 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-ee42f2c4-b6fd-49b1-9cc6-a42f581044db tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:50.454580 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-ee42f2c4-b6fd-49b1-9cc6-a42f581044db tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca" status: 200 len: 1276 microversion: 2.1 time: 0.908087 Apr 30 13:16:50.470057 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 23/37] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:16:49 2021] GET /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca => generated 1276 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:50.577940 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-8cede71d-21bb-40b6-9bb8-a10830d53513 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7d9d559fcc4228a382dc23989d601e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dda396dc145d58b214518705a9227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:50.590923 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-8cede71d-21bb-40b6-9bb8-a10830d53513 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] 10.222.0.79 "GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd" status: 200 len: 1266 microversion: 2.1 time: 1.210946 Apr 30 13:16:50.605310 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 15/38] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:16:49 2021] GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd => generated 1266 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:51.471350 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-974fe826-ee85-418f-8cd0-b74b24929f4e tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:51.472636 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-974fe826-ee85-418f-8cd0-b74b24929f4e tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: d94a56dc-cb9d-4b55-9f89-b121d45230ca] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:51.505358 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-974fe826-ee85-418f-8cd0-b74b24929f4e tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:51.506138 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-974fe826-ee85-418f-8cd0-b74b24929f4e tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:51.509744 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-974fe826-ee85-418f-8cd0-b74b24929f4e tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:51.512596 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-974fe826-ee85-418f-8cd0-b74b24929f4e tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:51.618482 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-7689e0a4-75c0-4a10-b452-0509170db90f tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:51.619371 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-7689e0a4-75c0-4a10-b452-0509170db90f tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] [instance: 272025ed-c9af-4c21-8df7-b4ebc88b96cd] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:51.636529 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7689e0a4-75c0-4a10-b452-0509170db90f tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:51.639400 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7689e0a4-75c0-4a10-b452-0509170db90f tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:51.640401 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7689e0a4-75c0-4a10-b452-0509170db90f tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:51.643350 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7689e0a4-75c0-4a10-b452-0509170db90f tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:51.933796 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-7689e0a4-75c0-4a10-b452-0509170db90f tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7d9d559fcc4228a382dc23989d601e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dda396dc145d58b214518705a9227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:51.945015 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-7689e0a4-75c0-4a10-b452-0509170db90f tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] 10.222.0.79 "GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd" status: 200 len: 1272 microversion: 2.1 time: 0.336177 Apr 30 13:16:51.951871 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 16/39] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:16:51 2021] GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd => generated 1272 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:52.968974 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-13e8938e-8716-40dc-b0b5-594329af413a tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:52.969726 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-13e8938e-8716-40dc-b0b5-594329af413a tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] [instance: 272025ed-c9af-4c21-8df7-b4ebc88b96cd] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:52.984139 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-13e8938e-8716-40dc-b0b5-594329af413a tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:52.984609 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-13e8938e-8716-40dc-b0b5-594329af413a tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:52.986934 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-13e8938e-8716-40dc-b0b5-594329af413a tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:52.987558 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-13e8938e-8716-40dc-b0b5-594329af413a tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:53.243806 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-974fe826-ee85-418f-8cd0-b74b24929f4e tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:53.258307 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-974fe826-ee85-418f-8cd0-b74b24929f4e tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca" status: 200 len: 1318 microversion: 2.1 time: 1.790687 Apr 30 13:16:53.272763 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 24/40] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:16:51 2021] GET /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca => generated 1318 bytes in 1806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:53.935966 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-13e8938e-8716-40dc-b0b5-594329af413a tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7d9d559fcc4228a382dc23989d601e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dda396dc145d58b214518705a9227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:53.959246 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-13e8938e-8716-40dc-b0b5-594329af413a tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] 10.222.0.79 "GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd" status: 200 len: 1272 microversion: 2.1 time: 0.994044 Apr 30 13:16:53.970376 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 17/41] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:16:52 2021] GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd => generated 1272 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:54.228248 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-deece557-a27a-4c10-bfa4-58d4dee91468 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-931499152", "imageRef": "705a0c6b-b003-4687-84bf-8b9f87dae39e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8d9ca312-d14a-4afb-916b-be4034fb8fea"}]}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:16:54.280331 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-ed9ca5e8-dc8a-4979-85a0-8c2b170f7bfe tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:54.280976 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-ed9ca5e8-dc8a-4979-85a0-8c2b170f7bfe tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: d94a56dc-cb9d-4b55-9f89-b121d45230ca] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:54.302717 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ed9ca5e8-dc8a-4979-85a0-8c2b170f7bfe tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:54.303253 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ed9ca5e8-dc8a-4979-85a0-8c2b170f7bfe tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:54.304113 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ed9ca5e8-dc8a-4979-85a0-8c2b170f7bfe tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:54.304562 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ed9ca5e8-dc8a-4979-85a0-8c2b170f7bfe tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:54.445730 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.network.neutron [None req-deece557-a27a-4c10-bfa4-58d4dee91468 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] validate_networks() for [('8d9ca312-d14a-4afb-916b-be4034fb8fea', None, None, None)] {{(pid=87933) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 13:16:57.337739 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-ed9ca5e8-dc8a-4979-85a0-8c2b170f7bfe tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:57.375537 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-ed9ca5e8-dc8a-4979-85a0-8c2b170f7bfe tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca" status: 200 len: 1318 microversion: 2.1 time: 3.099564 Apr 30 13:16:57.383392 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 18/42] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:16:54 2021] GET /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca => generated 1318 bytes in 3108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:16:57.446226 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-057d4787-1f9a-41e6-b600-50410946ba9f tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:57.450785 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-057d4787-1f9a-41e6-b600-50410946ba9f tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] [instance: 272025ed-c9af-4c21-8df7-b4ebc88b96cd] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:57.494768 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-057d4787-1f9a-41e6-b600-50410946ba9f tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:57.498848 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-057d4787-1f9a-41e6-b600-50410946ba9f tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:57.502418 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-057d4787-1f9a-41e6-b600-50410946ba9f tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:57.508229 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-057d4787-1f9a-41e6-b600-50410946ba9f tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:57.861698 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.virt.hardware [None req-deece557-a27a-4c10-bfa4-58d4dee91468 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Flavor limits 0:0:0 {{(pid=87933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 13:16:57.863114 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.virt.hardware [None req-deece557-a27a-4c10-bfa4-58d4dee91468 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Image limits 0:0:0 {{(pid=87933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 13:16:57.863851 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.virt.hardware [None req-deece557-a27a-4c10-bfa4-58d4dee91468 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Flavor pref 0:0:0 {{(pid=87933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 13:16:57.864489 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.virt.hardware [None req-deece557-a27a-4c10-bfa4-58d4dee91468 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Image pref 0:0:0 {{(pid=87933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 13:16:57.865302 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.virt.hardware [None req-deece557-a27a-4c10-bfa4-58d4dee91468 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 13:16:57.880945 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-deece557-a27a-4c10-bfa4-58d4dee91468 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:57.884938 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-deece557-a27a-4c10-bfa4-58d4dee91468 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:57.888414 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-deece557-a27a-4c10-bfa4-58d4dee91468 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:57.893436 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-deece557-a27a-4c10-bfa4-58d4dee91468 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:57.941151 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.quota [None req-deece557-a27a-4c10-bfa4-58d4dee91468 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Getting quotas for project c622a56261f04601a7a4b9b607f9eddd. Resources: {'ram', 'instances', 'cores'} {{(pid=87933) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:16:57.950394 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.quota [None req-deece557-a27a-4c10-bfa4-58d4dee91468 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Getting quotas for user 724ff4b164904585a857922d30c6752c and project c622a56261f04601a7a4b9b607f9eddd. Resources: {'ram', 'instances', 'cores'} {{(pid=87933) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:16:57.981443 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-deece557-a27a-4c10-bfa4-58d4dee91468 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Going to run 1 instances... {{(pid=87933) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 13:16:57.993429 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-deece557-a27a-4c10-bfa4-58d4dee91468 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='705a0c6b-b003-4687-84bf-8b9f87dae39e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=87933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 13:16:58.148227 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-deece557-a27a-4c10-bfa4-58d4dee91468 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.874108 Apr 30 13:16:58.158390 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 25/43] 10.222.0.79 () {60 vars in 1147 bytes} [Fri Apr 30 13:16:53 2021] POST /compute/v2.1/servers => generated 383 bytes in 4885 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 13:16:58.171129 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-e3c25cb7-665d-4a9c-919f-4c87d6db3ce3 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:58.176253 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-e3c25cb7-665d-4a9c-919f-4c87d6db3ce3 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:59.455568 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-e3c25cb7-665d-4a9c-919f-4c87d6db3ce3 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:16:59.463899 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-e3c25cb7-665d-4a9c-919f-4c87d6db3ce3 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1221 microversion: 2.1 time: 1.304075 Apr 30 13:16:59.464497 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 26/44] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:16:58 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1221 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:16:59.509531 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-a342079c-5a97-4941-9078-dd28b43f086b tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:16:59.523718 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-a342079c-5a97-4941-9078-dd28b43f086b tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: d94a56dc-cb9d-4b55-9f89-b121d45230ca] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:16:59.559466 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a342079c-5a97-4941-9078-dd28b43f086b tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:59.574551 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a342079c-5a97-4941-9078-dd28b43f086b tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:16:59.576312 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a342079c-5a97-4941-9078-dd28b43f086b tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:16:59.577397 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a342079c-5a97-4941-9078-dd28b43f086b tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:00.375258 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-057d4787-1f9a-41e6-b600-50410946ba9f tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7d9d559fcc4228a382dc23989d601e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dda396dc145d58b214518705a9227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:00.405849 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-057d4787-1f9a-41e6-b600-50410946ba9f tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] 10.222.0.79 "GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd" status: 200 len: 1314 microversion: 2.1 time: 2.991493 Apr 30 13:17:00.406604 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 19/45] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:16:57 2021] GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd => generated 1314 bytes in 3023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:00.446871 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-0f037f64-459f-4600-b127-4cdae6df0d1d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1813158763", "imageRef": "705a0c6b-b003-4687-84bf-8b9f87dae39e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8d9ca312-d14a-4afb-916b-be4034fb8fea"}]}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:00.657247 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.network.neutron [None req-0f037f64-459f-4600-b127-4cdae6df0d1d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] validate_networks() for [('8d9ca312-d14a-4afb-916b-be4034fb8fea', None, None, None)] {{(pid=87932) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 13:17:00.831974 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-a342079c-5a97-4941-9078-dd28b43f086b tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:00.848903 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-a342079c-5a97-4941-9078-dd28b43f086b tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca" status: 200 len: 1318 microversion: 2.1 time: 1.343424 Apr 30 13:17:00.858546 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 27/46] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:16:59 2021] GET /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca => generated 1318 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:01.353533 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [req-9d11219c-8b82-4fad-9276-fb879cdda187 req-a22e91dc-816b-402e-9513-0bbc435b46f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d94a56dc-cb9d-4b55-9f89-b121d45230ca", "tag": "50ec7608-d829-47e1-b2f7-14e702acb0fc"}]} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:01.360336 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:17:01.360336 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: warnings.warn(msg) Apr 30 13:17:01.399999 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-9d11219c-8b82-4fad-9276-fb879cdda187 req-a22e91dc-816b-402e-9513-0bbc435b46f0 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:01.405732 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-9d11219c-8b82-4fad-9276-fb879cdda187 req-a22e91dc-816b-402e-9513-0bbc435b46f0 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:01.532228 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.compute.server_external_events [req-9d11219c-8b82-4fad-9276-fb879cdda187 req-a22e91dc-816b-402e-9513-0bbc435b46f0 service nova] Creating event network-changed:50ec7608-d829-47e1-b2f7-14e702acb0fc for instance d94a56dc-cb9d-4b55-9f89-b121d45230ca on hv-cinder-78836 Apr 30 13:17:01.543899 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-9d11219c-8b82-4fad-9276-fb879cdda187 req-a22e91dc-816b-402e-9513-0bbc435b46f0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=87933) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Apr 30 13:17:01.544530 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-faddb966-33cd-4f89-b25d-d384703273d3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:01.544999 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-faddb966-33cd-4f89-b25d-d384703273d3 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:01.545822 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-faddb966-33cd-4f89-b25d-d384703273d3 None None] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:01.606918 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-faddb966-33cd-4f89-b25d-d384703273d3 None None] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:01.632353 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.compute.rpcapi [None req-faddb966-33cd-4f89-b25d-d384703273d3 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Apr 30 13:17:01.633702 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-faddb966-33cd-4f89-b25d-d384703273d3 None None] Releasing lock "compute-rpcapi-router" {{(pid=87933) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Apr 30 13:17:01.705705 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-faddb966-33cd-4f89-b25d-d384703273d3 None None] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.845281 Apr 30 13:17:01.706419 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 28/47] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:17:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:17:02.198878 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-ea20453d-e502-4d24-b680-214e7c5072ad tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'create', calling method: .version_select at 0x7f7500c6f160>, body: {"keypair": {"name": "tempest-keypair-1812664701"}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:02.250533 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.quota [None req-ea20453d-e502-4d24-b680-214e7c5072ad tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Getting quotas for project 092cf09caa34460587230269b2e28a23. Resources: {'key_pairs'} {{(pid=87933) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:17:02.258805 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.quota [None req-ea20453d-e502-4d24-b680-214e7c5072ad tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Getting quotas for user 1014c3ed5ee9414b96f591b3b397a981 and project 092cf09caa34460587230269b2e28a23. Resources: {'key_pairs'} {{(pid=87933) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:17:02.671130 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.quota [None req-ea20453d-e502-4d24-b680-214e7c5072ad tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Getting quotas for project 092cf09caa34460587230269b2e28a23. Resources: {'key_pairs'} {{(pid=87933) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:17:02.689352 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.quota [None req-ea20453d-e502-4d24-b680-214e7c5072ad tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Getting quotas for user 1014c3ed5ee9414b96f591b3b397a981 and project 092cf09caa34460587230269b2e28a23. Resources: {'key_pairs'} {{(pid=87933) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:17:02.738560 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-ea20453d-e502-4d24-b680-214e7c5072ad tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 1.030607 Apr 30 13:17:02.740217 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 29/48] 10.222.0.79 () {62 vars in 1199 bytes} [Fri Apr 30 13:17:01 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 1033 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 30 13:17:02.753470 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-4f2ce855-9473-460a-a89d-90500d94aeca tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:02.754620 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-4f2ce855-9473-460a-a89d-90500d94aeca tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] [instance: 272025ed-c9af-4c21-8df7-b4ebc88b96cd] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:02.766584 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4f2ce855-9473-460a-a89d-90500d94aeca tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:02.767973 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4f2ce855-9473-460a-a89d-90500d94aeca tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:02.769303 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4f2ce855-9473-460a-a89d-90500d94aeca tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:02.770469 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4f2ce855-9473-460a-a89d-90500d94aeca tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:04.071726 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-0f037f64-459f-4600-b127-4cdae6df0d1d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Flavor limits 0:0:0 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 13:17:04.073233 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-0f037f64-459f-4600-b127-4cdae6df0d1d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Image limits 0:0:0 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 13:17:04.074002 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-0f037f64-459f-4600-b127-4cdae6df0d1d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Flavor pref 0:0:0 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 13:17:04.075156 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-0f037f64-459f-4600-b127-4cdae6df0d1d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Image pref 0:0:0 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 13:17:04.076002 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-0f037f64-459f-4600-b127-4cdae6df0d1d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 13:17:04.095243 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0f037f64-459f-4600-b127-4cdae6df0d1d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:04.100317 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0f037f64-459f-4600-b127-4cdae6df0d1d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:04.105912 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0f037f64-459f-4600-b127-4cdae6df0d1d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:04.108049 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0f037f64-459f-4600-b127-4cdae6df0d1d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:04.240396 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.quota [None req-0f037f64-459f-4600-b127-4cdae6df0d1d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Getting quotas for project c622a56261f04601a7a4b9b607f9eddd. Resources: {'ram', 'instances', 'cores'} {{(pid=87932) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:17:04.265884 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.quota [None req-0f037f64-459f-4600-b127-4cdae6df0d1d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Getting quotas for user 724ff4b164904585a857922d30c6752c and project c622a56261f04601a7a4b9b607f9eddd. Resources: {'ram', 'instances', 'cores'} {{(pid=87932) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:17:04.316634 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-0f037f64-459f-4600-b127-4cdae6df0d1d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Going to run 1 instances... {{(pid=87932) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 13:17:04.327105 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-0f037f64-459f-4600-b127-4cdae6df0d1d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='705a0c6b-b003-4687-84bf-8b9f87dae39e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=87932) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 13:17:04.528715 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-0f037f64-459f-4600-b127-4cdae6df0d1d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.117044 Apr 30 13:17:04.533085 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 20/49] 10.222.0.79 () {60 vars in 1147 bytes} [Fri Apr 30 13:17:00 2021] POST /compute/v2.1/servers => generated 383 bytes in 4125 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 13:17:04.579369 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-66b86e5a-0564-4ac2-94fb-2da0e2523b1a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:04.585793 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-66b86e5a-0564-4ac2-94fb-2da0e2523b1a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: d94a56dc-cb9d-4b55-9f89-b121d45230ca] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:04.634273 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-66b86e5a-0564-4ac2-94fb-2da0e2523b1a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:04.642442 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-66b86e5a-0564-4ac2-94fb-2da0e2523b1a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:04.646243 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-66b86e5a-0564-4ac2-94fb-2da0e2523b1a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:04.654141 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-66b86e5a-0564-4ac2-94fb-2da0e2523b1a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:05.390054 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-4f2ce855-9473-460a-a89d-90500d94aeca tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7d9d559fcc4228a382dc23989d601e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dda396dc145d58b214518705a9227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:05.449154 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-4f2ce855-9473-460a-a89d-90500d94aeca tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] 10.222.0.79 "GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd" status: 200 len: 1314 microversion: 2.1 time: 2.706167 Apr 30 13:17:05.491710 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 30/50] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:02 2021] GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd => generated 1314 bytes in 2750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:05.518446 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [req-638daac5-b408-493b-8b3d-0a47bbe97f5f req-cacd4b8e-8b90-4e2e-83d3-4413ec971ced service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "272025ed-c9af-4c21-8df7-b4ebc88b96cd", "tag": "78b0cb3a-ee36-43df-b7c5-35915a242f36"}]} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:05.520610 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:17:05.520610 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: warnings.warn(msg) Apr 30 13:17:05.540618 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-638daac5-b408-493b-8b3d-0a47bbe97f5f req-cacd4b8e-8b90-4e2e-83d3-4413ec971ced service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:05.541993 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-638daac5-b408-493b-8b3d-0a47bbe97f5f req-cacd4b8e-8b90-4e2e-83d3-4413ec971ced service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:05.602765 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.compute.server_external_events [req-638daac5-b408-493b-8b3d-0a47bbe97f5f req-cacd4b8e-8b90-4e2e-83d3-4413ec971ced service nova] Creating event network-changed:78b0cb3a-ee36-43df-b7c5-35915a242f36 for instance 272025ed-c9af-4c21-8df7-b4ebc88b96cd on hv-cinder-78836 Apr 30 13:17:05.620496 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [req-638daac5-b408-493b-8b3d-0a47bbe97f5f req-cacd4b8e-8b90-4e2e-83d3-4413ec971ced service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125410 Apr 30 13:17:05.621429 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 31/51] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:17:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:17:05.643379 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-bc72c7bc-2b62-45ee-a5b3-ee3c95d3a55d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:05.646437 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-bc72c7bc-2b62-45ee-a5b3-ee3c95d3a55d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:05.671972 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-bc72c7bc-2b62-45ee-a5b3-ee3c95d3a55d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:05.672860 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-bc72c7bc-2b62-45ee-a5b3-ee3c95d3a55d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:05.674067 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-bc72c7bc-2b62-45ee-a5b3-ee3c95d3a55d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:05.674803 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-bc72c7bc-2b62-45ee-a5b3-ee3c95d3a55d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:06.038261 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-bc72c7bc-2b62-45ee-a5b3-ee3c95d3a55d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:06.054684 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-bc72c7bc-2b62-45ee-a5b3-ee3c95d3a55d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1218 microversion: 2.1 time: 0.425318 Apr 30 13:17:06.055231 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 32/52] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:05 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1218 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:06.504564 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-d2a1a384-c9e2-4938-802a-c0a4286e8a27 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:06.505134 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-d2a1a384-c9e2-4938-802a-c0a4286e8a27 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] [instance: 272025ed-c9af-4c21-8df7-b4ebc88b96cd] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:06.520443 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d2a1a384-c9e2-4938-802a-c0a4286e8a27 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:06.522187 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d2a1a384-c9e2-4938-802a-c0a4286e8a27 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:06.524470 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d2a1a384-c9e2-4938-802a-c0a4286e8a27 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:06.525222 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d2a1a384-c9e2-4938-802a-c0a4286e8a27 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:07.062845 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-66b86e5a-0564-4ac2-94fb-2da0e2523b1a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:07.079381 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-66b86e5a-0564-4ac2-94fb-2da0e2523b1a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca" status: 200 len: 1318 microversion: 2.1 time: 2.541473 Apr 30 13:17:07.079966 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 21/53] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:04 2021] GET /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca => generated 1318 bytes in 2546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:07.092084 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-42084a04-3da1-4004-8b99-7a521d022874 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:07.092738 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-42084a04-3da1-4004-8b99-7a521d022874 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:07.120371 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-42084a04-3da1-4004-8b99-7a521d022874 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:07.121566 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-42084a04-3da1-4004-8b99-7a521d022874 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:07.122186 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-42084a04-3da1-4004-8b99-7a521d022874 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:07.122753 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-42084a04-3da1-4004-8b99-7a521d022874 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:07.474269 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-42084a04-3da1-4004-8b99-7a521d022874 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:07.487578 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-42084a04-3da1-4004-8b99-7a521d022874 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1282 microversion: 2.1 time: 0.403711 Apr 30 13:17:07.489625 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 22/54] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:07 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1282 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:07.591417 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-d2a1a384-c9e2-4938-802a-c0a4286e8a27 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7d9d559fcc4228a382dc23989d601e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dda396dc145d58b214518705a9227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:07.605404 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-d2a1a384-c9e2-4938-802a-c0a4286e8a27 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] 10.222.0.79 "GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd" status: 200 len: 1314 microversion: 2.1 time: 1.103999 Apr 30 13:17:07.606988 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 33/55] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:06 2021] GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd => generated 1314 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:08.097320 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-bf74f3cd-7c9a-44ed-8ba7-e64bc686a112 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:08.097959 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-bf74f3cd-7c9a-44ed-8ba7-e64bc686a112 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: d94a56dc-cb9d-4b55-9f89-b121d45230ca] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:08.108640 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-bf74f3cd-7c9a-44ed-8ba7-e64bc686a112 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:08.109391 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-bf74f3cd-7c9a-44ed-8ba7-e64bc686a112 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:08.110962 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-bf74f3cd-7c9a-44ed-8ba7-e64bc686a112 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:08.111552 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-bf74f3cd-7c9a-44ed-8ba7-e64bc686a112 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:08.507657 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-98e0c9f9-0b65-4cad-b283-fa7daa77b4a0 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:08.512542 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-98e0c9f9-0b65-4cad-b283-fa7daa77b4a0 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:08.551502 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-98e0c9f9-0b65-4cad-b283-fa7daa77b4a0 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:08.554144 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-98e0c9f9-0b65-4cad-b283-fa7daa77b4a0 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:08.555625 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-98e0c9f9-0b65-4cad-b283-fa7daa77b4a0 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:08.558108 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-98e0c9f9-0b65-4cad-b283-fa7daa77b4a0 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:08.774226 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-98e0c9f9-0b65-4cad-b283-fa7daa77b4a0 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:08.786484 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-98e0c9f9-0b65-4cad-b283-fa7daa77b4a0 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1280 microversion: 2.1 time: 0.284328 Apr 30 13:17:08.788812 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 34/56] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:08 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1280 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:08.803261 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-d83b9064-68fb-4468-b53c-02ac46bc0bf1 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:08.804248 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-d83b9064-68fb-4468-b53c-02ac46bc0bf1 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] [instance: 272025ed-c9af-4c21-8df7-b4ebc88b96cd] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:08.814863 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d83b9064-68fb-4468-b53c-02ac46bc0bf1 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:08.816467 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d83b9064-68fb-4468-b53c-02ac46bc0bf1 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:08.818599 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d83b9064-68fb-4468-b53c-02ac46bc0bf1 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:08.819628 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d83b9064-68fb-4468-b53c-02ac46bc0bf1 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:09.704359 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-d83b9064-68fb-4468-b53c-02ac46bc0bf1 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7d9d559fcc4228a382dc23989d601e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dda396dc145d58b214518705a9227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:09.714417 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-d83b9064-68fb-4468-b53c-02ac46bc0bf1 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] 10.222.0.79 "GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd" status: 200 len: 1314 microversion: 2.1 time: 0.915437 Apr 30 13:17:09.726778 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 35/57] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:08 2021] GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd => generated 1314 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:09.923076 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [req-970d8b0e-f0a5-4f72-b4e2-d0728cc7f4a3 req-f1fd8cca-4a17-4bb6-b735-24b4968d948d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa7277ee-287a-481c-a0e8-ae4dc4053a0e", "tag": "3291dc06-c1f9-4322-b292-ef88b1d2e531"}]} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:09.924662 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:17:09.924662 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: warnings.warn(msg) Apr 30 13:17:09.945460 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-970d8b0e-f0a5-4f72-b4e2-d0728cc7f4a3 req-f1fd8cca-4a17-4bb6-b735-24b4968d948d service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:09.945921 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-970d8b0e-f0a5-4f72-b4e2-d0728cc7f4a3 req-f1fd8cca-4a17-4bb6-b735-24b4968d948d service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:09.969955 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.compute.server_external_events [req-970d8b0e-f0a5-4f72-b4e2-d0728cc7f4a3 req-f1fd8cca-4a17-4bb6-b735-24b4968d948d service nova] Creating event network-changed:3291dc06-c1f9-4322-b292-ef88b1d2e531 for instance aa7277ee-287a-481c-a0e8-ae4dc4053a0e on hv-cinder-78836 Apr 30 13:17:09.978830 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [req-970d8b0e-f0a5-4f72-b4e2-d0728cc7f4a3 req-f1fd8cca-4a17-4bb6-b735-24b4968d948d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.250412 Apr 30 13:17:09.979854 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 36/58] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:17:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:17:09.989393 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-0485a96d-0740-4c1f-b2fb-b4d8130f00ab tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:09.990865 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-0485a96d-0740-4c1f-b2fb-b4d8130f00ab tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:09.999572 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0485a96d-0740-4c1f-b2fb-b4d8130f00ab tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:10.000374 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0485a96d-0740-4c1f-b2fb-b4d8130f00ab tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:10.001389 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0485a96d-0740-4c1f-b2fb-b4d8130f00ab tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:10.002078 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0485a96d-0740-4c1f-b2fb-b4d8130f00ab tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:10.317624 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-0485a96d-0740-4c1f-b2fb-b4d8130f00ab tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:10.335807 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-0485a96d-0740-4c1f-b2fb-b4d8130f00ab tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1280 microversion: 2.1 time: 0.351913 Apr 30 13:17:10.348164 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 37/59] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:09 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1280 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:10.380647 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-bf74f3cd-7c9a-44ed-8ba7-e64bc686a112 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:10.401311 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-bf74f3cd-7c9a-44ed-8ba7-e64bc686a112 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca" status: 200 len: 1318 microversion: 2.1 time: 2.305544 Apr 30 13:17:10.412267 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 23/60] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:08 2021] GET /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca => generated 1318 bytes in 2319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:10.743340 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-0c279ecb-f6bb-4737-825b-db54318b7a4d tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:10.744674 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-0c279ecb-f6bb-4737-825b-db54318b7a4d tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] [instance: 272025ed-c9af-4c21-8df7-b4ebc88b96cd] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:10.763096 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0c279ecb-f6bb-4737-825b-db54318b7a4d tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:10.765068 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0c279ecb-f6bb-4737-825b-db54318b7a4d tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:10.766067 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0c279ecb-f6bb-4737-825b-db54318b7a4d tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:10.769093 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0c279ecb-f6bb-4737-825b-db54318b7a4d tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:11.114853 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-80624983-4eb5-4856-87db-4231d5009bfe tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-865047118", "imageRef": "705a0c6b-b003-4687-84bf-8b9f87dae39e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b393ed9b-4720-4bf4-967f-18d64ce498cd"}], "security_groups": [{"name": "tempest-securitygroup--325852446"}], "key_name": "tempest-keypair-1812664701", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:11.322670 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-0c279ecb-f6bb-4737-825b-db54318b7a4d tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7d9d559fcc4228a382dc23989d601e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dda396dc145d58b214518705a9227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:11.335649 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-0c279ecb-f6bb-4737-825b-db54318b7a4d tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] 10.222.0.79 "GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd" status: 200 len: 1314 microversion: 2.1 time: 0.593816 Apr 30 13:17:11.336507 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 38/61] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:10 2021] GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd => generated 1314 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:11.355724 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b382ed4d-6a9a-47b8-8363-f425448c3444 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:11.357048 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-b382ed4d-6a9a-47b8-8363-f425448c3444 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:11.372647 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b382ed4d-6a9a-47b8-8363-f425448c3444 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:11.373386 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b382ed4d-6a9a-47b8-8363-f425448c3444 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:11.374844 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b382ed4d-6a9a-47b8-8363-f425448c3444 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:11.377524 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b382ed4d-6a9a-47b8-8363-f425448c3444 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:11.725277 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-b382ed4d-6a9a-47b8-8363-f425448c3444 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:11.740815 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b382ed4d-6a9a-47b8-8363-f425448c3444 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1280 microversion: 2.1 time: 0.389286 Apr 30 13:17:11.742255 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 39/62] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:11 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1280 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:17:11.751402 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-9cf015c5-34bc-4d49-b164-a67f433c6a2e tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:11.752877 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-9cf015c5-34bc-4d49-b164-a67f433c6a2e tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: d94a56dc-cb9d-4b55-9f89-b121d45230ca] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:11.767495 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9cf015c5-34bc-4d49-b164-a67f433c6a2e tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:11.768357 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9cf015c5-34bc-4d49-b164-a67f433c6a2e tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:11.769806 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9cf015c5-34bc-4d49-b164-a67f433c6a2e tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:11.770674 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9cf015c5-34bc-4d49-b164-a67f433c6a2e tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:12.006691 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.network.neutron [None req-80624983-4eb5-4856-87db-4231d5009bfe tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] validate_networks() for [('b393ed9b-4720-4bf4-967f-18d64ce498cd', None, None, None)] {{(pid=87932) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 13:17:12.387681 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-9cf015c5-34bc-4d49-b164-a67f433c6a2e tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:12.404704 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-9cf015c5-34bc-4d49-b164-a67f433c6a2e tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca" status: 200 len: 1318 microversion: 2.1 time: 0.660670 Apr 30 13:17:12.405693 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 40/63] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:11 2021] GET /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca => generated 1318 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:12.410849 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-7998f8d9-1d72-4561-84d4-fe0113a988d7 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:12.412134 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-7998f8d9-1d72-4561-84d4-fe0113a988d7 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] [instance: 272025ed-c9af-4c21-8df7-b4ebc88b96cd] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:12.421275 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7998f8d9-1d72-4561-84d4-fe0113a988d7 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:12.422780 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7998f8d9-1d72-4561-84d4-fe0113a988d7 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:12.424777 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7998f8d9-1d72-4561-84d4-fe0113a988d7 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:12.425877 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7998f8d9-1d72-4561-84d4-fe0113a988d7 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:13.060963 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-7998f8d9-1d72-4561-84d4-fe0113a988d7 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7d9d559fcc4228a382dc23989d601e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dda396dc145d58b214518705a9227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:13.075566 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-7998f8d9-1d72-4561-84d4-fe0113a988d7 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] 10.222.0.79 "GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd" status: 200 len: 1314 microversion: 2.1 time: 0.668462 Apr 30 13:17:13.076399 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 41/64] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:12 2021] GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd => generated 1314 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:13.087301 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-2533c228-3c97-4c77-9eae-011f116d51a5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:13.088818 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-2533c228-3c97-4c77-9eae-011f116d51a5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:13.115425 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2533c228-3c97-4c77-9eae-011f116d51a5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:13.115891 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2533c228-3c97-4c77-9eae-011f116d51a5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:13.118060 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2533c228-3c97-4c77-9eae-011f116d51a5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:13.128854 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2533c228-3c97-4c77-9eae-011f116d51a5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:13.769755 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-2533c228-3c97-4c77-9eae-011f116d51a5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:13.784785 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-2533c228-3c97-4c77-9eae-011f116d51a5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1322 microversion: 2.1 time: 0.706943 Apr 30 13:17:13.787081 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 42/65] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:13 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1322 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:13.793363 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-33f8d78f-921f-4cc0-a229-0d64b3702c9b tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:13.794334 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-33f8d78f-921f-4cc0-a229-0d64b3702c9b tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: d94a56dc-cb9d-4b55-9f89-b121d45230ca] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:13.817119 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-33f8d78f-921f-4cc0-a229-0d64b3702c9b tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:13.818536 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-33f8d78f-921f-4cc0-a229-0d64b3702c9b tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:13.823080 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-33f8d78f-921f-4cc0-a229-0d64b3702c9b tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:13.823807 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-33f8d78f-921f-4cc0-a229-0d64b3702c9b tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:14.289295 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-33f8d78f-921f-4cc0-a229-0d64b3702c9b tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:14.313650 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-33f8d78f-921f-4cc0-a229-0d64b3702c9b tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca" status: 200 len: 1318 microversion: 2.1 time: 0.524040 Apr 30 13:17:14.319323 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 43/66] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:13 2021] GET /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca => generated 1318 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:14.330812 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-609ead7e-46e6-436c-8719-5ea8bc36d4cf tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:14.334755 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-609ead7e-46e6-436c-8719-5ea8bc36d4cf tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] [instance: 272025ed-c9af-4c21-8df7-b4ebc88b96cd] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:14.351126 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-609ead7e-46e6-436c-8719-5ea8bc36d4cf tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:14.355906 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-80624983-4eb5-4856-87db-4231d5009bfe tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Flavor limits 0:0:0 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 13:17:14.357083 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-609ead7e-46e6-436c-8719-5ea8bc36d4cf tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:14.357390 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-80624983-4eb5-4856-87db-4231d5009bfe tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Image limits 0:0:0 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 13:17:14.358056 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-80624983-4eb5-4856-87db-4231d5009bfe tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Flavor pref 0:0:0 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 13:17:14.358249 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-609ead7e-46e6-436c-8719-5ea8bc36d4cf tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:14.358794 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-609ead7e-46e6-436c-8719-5ea8bc36d4cf tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:14.359218 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-80624983-4eb5-4856-87db-4231d5009bfe tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Image pref 0:0:0 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 13:17:14.360007 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-80624983-4eb5-4856-87db-4231d5009bfe tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 13:17:14.376874 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-80624983-4eb5-4856-87db-4231d5009bfe tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:14.380848 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-80624983-4eb5-4856-87db-4231d5009bfe tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:14.382132 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-80624983-4eb5-4856-87db-4231d5009bfe tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:14.383431 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-80624983-4eb5-4856-87db-4231d5009bfe tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:14.487238 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.quota [None req-80624983-4eb5-4856-87db-4231d5009bfe tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Getting quotas for project 092cf09caa34460587230269b2e28a23. Resources: {'ram', 'instances', 'cores'} {{(pid=87932) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:17:14.499449 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.quota [None req-80624983-4eb5-4856-87db-4231d5009bfe tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Getting quotas for user 1014c3ed5ee9414b96f591b3b397a981 and project 092cf09caa34460587230269b2e28a23. Resources: {'ram', 'instances', 'cores'} {{(pid=87932) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:17:14.563278 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-80624983-4eb5-4856-87db-4231d5009bfe tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Going to run 1 instances... {{(pid=87932) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 13:17:14.571690 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-80624983-4eb5-4856-87db-4231d5009bfe tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='705a0c6b-b003-4687-84bf-8b9f87dae39e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=87932) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 13:17:14.692714 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-80624983-4eb5-4856-87db-4231d5009bfe tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.583140 Apr 30 13:17:14.703663 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 24/67] 10.222.0.79 () {62 vars in 1188 bytes} [Fri Apr 30 13:17:11 2021] POST /compute/v2.1/servers => generated 401 bytes in 3595 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 30 13:17:14.710959 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-93ce31c8-7915-4efa-bf04-7e5252b7092d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:14.711647 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-93ce31c8-7915-4efa-bf04-7e5252b7092d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:15.004274 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-93ce31c8-7915-4efa-bf04-7e5252b7092d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:15.017770 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-93ce31c8-7915-4efa-bf04-7e5252b7092d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:15.023244 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-93ce31c8-7915-4efa-bf04-7e5252b7092d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:15.024500 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-93ce31c8-7915-4efa-bf04-7e5252b7092d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1281 microversion: 2.20 time: 0.319760 Apr 30 13:17:15.044753 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 25/68] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:17:14 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1281 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:17:15.051119 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-3c601baf-fe44-4840-a263-096d4da6c7e3 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:15.051726 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-3c601baf-fe44-4840-a263-096d4da6c7e3 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:15.074981 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3c601baf-fe44-4840-a263-096d4da6c7e3 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:15.075592 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3c601baf-fe44-4840-a263-096d4da6c7e3 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:15.076603 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3c601baf-fe44-4840-a263-096d4da6c7e3 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:15.078702 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3c601baf-fe44-4840-a263-096d4da6c7e3 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:15.208637 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-609ead7e-46e6-436c-8719-5ea8bc36d4cf tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7d9d559fcc4228a382dc23989d601e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dda396dc145d58b214518705a9227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:15.231159 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-609ead7e-46e6-436c-8719-5ea8bc36d4cf tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] 10.222.0.79 "GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd" status: 200 len: 1314 microversion: 2.1 time: 0.910369 Apr 30 13:17:15.238355 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 44/69] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:14 2021] GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd => generated 1314 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:15.340749 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-d71b9edf-3f99-40bf-828b-97fb53353b87 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:15.341777 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-d71b9edf-3f99-40bf-828b-97fb53353b87 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: d94a56dc-cb9d-4b55-9f89-b121d45230ca] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:15.362058 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d71b9edf-3f99-40bf-828b-97fb53353b87 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:15.362589 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d71b9edf-3f99-40bf-828b-97fb53353b87 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:15.363403 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d71b9edf-3f99-40bf-828b-97fb53353b87 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:15.363845 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d71b9edf-3f99-40bf-828b-97fb53353b87 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:15.918838 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-d71b9edf-3f99-40bf-828b-97fb53353b87 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:15.928153 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-d71b9edf-3f99-40bf-828b-97fb53353b87 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca" status: 200 len: 1318 microversion: 2.1 time: 0.595197 Apr 30 13:17:15.932873 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 45/70] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:15 2021] GET /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca => generated 1318 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:16.252167 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [req-d3a518b8-e2b4-46a0-8559-1d67ca633f59 req-c118346f-4d19-4df6-a58b-d806543207f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d94a56dc-cb9d-4b55-9f89-b121d45230ca", "name": "network-vif-plugged", "status": "completed", "tag": "50ec7608-d829-47e1-b2f7-14e702acb0fc"}]} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:16.254085 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:17:16.254085 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: warnings.warn(msg) Apr 30 13:17:16.277737 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-d3a518b8-e2b4-46a0-8559-1d67ca633f59 req-c118346f-4d19-4df6-a58b-d806543207f5 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:16.278221 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-d3a518b8-e2b4-46a0-8559-1d67ca633f59 req-c118346f-4d19-4df6-a58b-d806543207f5 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:16.310483 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.compute.server_external_events [req-d3a518b8-e2b4-46a0-8559-1d67ca633f59 req-c118346f-4d19-4df6-a58b-d806543207f5 service nova] Creating event network-vif-plugged:50ec7608-d829-47e1-b2f7-14e702acb0fc for instance d94a56dc-cb9d-4b55-9f89-b121d45230ca on hv-cinder-78836 Apr 30 13:17:16.318458 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [req-d3a518b8-e2b4-46a0-8559-1d67ca633f59 req-c118346f-4d19-4df6-a58b-d806543207f5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.384082 Apr 30 13:17:16.322885 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 46/71] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:17:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:17:16.339652 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-59d32b41-af98-4e15-8e1a-31002c3911f0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:16.340381 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-59d32b41-af98-4e15-8e1a-31002c3911f0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:16.363551 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-59d32b41-af98-4e15-8e1a-31002c3911f0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:16.364063 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-59d32b41-af98-4e15-8e1a-31002c3911f0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:16.365307 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-59d32b41-af98-4e15-8e1a-31002c3911f0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:16.370358 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-59d32b41-af98-4e15-8e1a-31002c3911f0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:16.569464 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-59d32b41-af98-4e15-8e1a-31002c3911f0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:16.586523 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-59d32b41-af98-4e15-8e1a-31002c3911f0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:16.589304 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-59d32b41-af98-4e15-8e1a-31002c3911f0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:16.590862 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-59d32b41-af98-4e15-8e1a-31002c3911f0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1333 microversion: 2.20 time: 0.262897 Apr 30 13:17:16.604572 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 47/72] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:17:16 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1333 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:17:16.621762 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-f16078ce-2c41-4781-bb08-c2f1a6de0406 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:16.625583 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-f16078ce-2c41-4781-bb08-c2f1a6de0406 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] [instance: 272025ed-c9af-4c21-8df7-b4ebc88b96cd] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:16.627811 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-3c601baf-fe44-4840-a263-096d4da6c7e3 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:16.642554 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f16078ce-2c41-4781-bb08-c2f1a6de0406 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:16.642918 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f16078ce-2c41-4781-bb08-c2f1a6de0406 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:16.644092 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f16078ce-2c41-4781-bb08-c2f1a6de0406 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:16.644908 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f16078ce-2c41-4781-bb08-c2f1a6de0406 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:16.646895 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-3c601baf-fe44-4840-a263-096d4da6c7e3 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1322 microversion: 2.1 time: 1.600835 Apr 30 13:17:16.651222 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 26/73] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:15 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1322 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:16.774874 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [req-d0037f86-41a8-43f5-a25d-6578767bb236 req-13348e10-6a91-4880-8fb4-ca1f54a89202 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c5fb2f8-696c-48e0-a4f2-c8410fec693f", "tag": "3bf7253a-ca9c-4a79-b9c4-d8404a9e675d"}]} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:16.778715 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:17:16.778715 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: warnings.warn(msg) Apr 30 13:17:16.800737 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-d0037f86-41a8-43f5-a25d-6578767bb236 req-13348e10-6a91-4880-8fb4-ca1f54a89202 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:16.801191 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-d0037f86-41a8-43f5-a25d-6578767bb236 req-13348e10-6a91-4880-8fb4-ca1f54a89202 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:16.836339 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.compute.server_external_events [req-d0037f86-41a8-43f5-a25d-6578767bb236 req-13348e10-6a91-4880-8fb4-ca1f54a89202 service nova] Creating event network-changed:3bf7253a-ca9c-4a79-b9c4-d8404a9e675d for instance 5c5fb2f8-696c-48e0-a4f2-c8410fec693f on hv-cinder-78836 Apr 30 13:17:16.836861 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-d0037f86-41a8-43f5-a25d-6578767bb236 req-13348e10-6a91-4880-8fb4-ca1f54a89202 service nova] Acquired lock "compute-rpcapi-router" {{(pid=87932) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Apr 30 13:17:16.847746 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a75734a1-3d94-4da5-a778-2f2ba3911846 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:16.848375 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a75734a1-3d94-4da5-a778-2f2ba3911846 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:16.850576 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a75734a1-3d94-4da5-a778-2f2ba3911846 None None] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:16.855150 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a75734a1-3d94-4da5-a778-2f2ba3911846 None None] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:16.877310 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.compute.rpcapi [None req-a75734a1-3d94-4da5-a778-2f2ba3911846 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Apr 30 13:17:16.879086 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a75734a1-3d94-4da5-a778-2f2ba3911846 None None] Releasing lock "compute-rpcapi-router" {{(pid=87932) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Apr 30 13:17:16.930704 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-a75734a1-3d94-4da5-a778-2f2ba3911846 None None] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159437 Apr 30 13:17:16.931965 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 27/74] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:17:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:17:16.951343 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-f9e74c7e-0fa8-4b3f-a10c-fe4b08defaae tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:16.952448 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-f9e74c7e-0fa8-4b3f-a10c-fe4b08defaae tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: d94a56dc-cb9d-4b55-9f89-b121d45230ca] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:16.967108 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f9e74c7e-0fa8-4b3f-a10c-fe4b08defaae tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:16.967867 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f9e74c7e-0fa8-4b3f-a10c-fe4b08defaae tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:16.969173 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f9e74c7e-0fa8-4b3f-a10c-fe4b08defaae tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:16.970052 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f9e74c7e-0fa8-4b3f-a10c-fe4b08defaae tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:17.142956 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-f16078ce-2c41-4781-bb08-c2f1a6de0406 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7d9d559fcc4228a382dc23989d601e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dda396dc145d58b214518705a9227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:17.151563 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-f16078ce-2c41-4781-bb08-c2f1a6de0406 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] 10.222.0.79 "GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd" status: 200 len: 1314 microversion: 2.1 time: 0.545704 Apr 30 13:17:17.152150 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 48/75] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:16 2021] GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd => generated 1314 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:17.302910 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-f9e74c7e-0fa8-4b3f-a10c-fe4b08defaae tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:17.315291 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-f9e74c7e-0fa8-4b3f-a10c-fe4b08defaae tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca" status: 200 len: 1318 microversion: 2.1 time: 0.369447 Apr 30 13:17:17.316307 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 28/76] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:16 2021] GET /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca => generated 1318 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:17:17.611525 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-f923fdfe-4f29-437c-8628-de24f8982e74 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:17.613280 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-f923fdfe-4f29-437c-8628-de24f8982e74 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:17.624261 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f923fdfe-4f29-437c-8628-de24f8982e74 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:17.624940 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f923fdfe-4f29-437c-8628-de24f8982e74 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:17.625965 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f923fdfe-4f29-437c-8628-de24f8982e74 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:17.626632 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f923fdfe-4f29-437c-8628-de24f8982e74 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:17.684248 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-115c216f-20d4-410a-8de6-24847b860333 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:17.685028 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-115c216f-20d4-410a-8de6-24847b860333 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:17.705238 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-115c216f-20d4-410a-8de6-24847b860333 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:17.709983 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-115c216f-20d4-410a-8de6-24847b860333 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:17.715271 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-115c216f-20d4-410a-8de6-24847b860333 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:17.716038 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-115c216f-20d4-410a-8de6-24847b860333 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:17.825284 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-f923fdfe-4f29-437c-8628-de24f8982e74 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:17.846699 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-f923fdfe-4f29-437c-8628-de24f8982e74 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:17.848462 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-f923fdfe-4f29-437c-8628-de24f8982e74 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:17.852315 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-f923fdfe-4f29-437c-8628-de24f8982e74 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1341 microversion: 2.20 time: 0.244680 Apr 30 13:17:17.853005 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 49/77] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:17:17 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1341 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:17:18.136855 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-115c216f-20d4-410a-8de6-24847b860333 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:18.148860 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-115c216f-20d4-410a-8de6-24847b860333 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1322 microversion: 2.1 time: 0.469495 Apr 30 13:17:18.151899 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 29/78] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:17 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1322 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:18.171623 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-68269585-00a4-49ff-afd4-1e9efc5e3955 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:18.172728 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-68269585-00a4-49ff-afd4-1e9efc5e3955 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] [instance: 272025ed-c9af-4c21-8df7-b4ebc88b96cd] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:18.187064 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-68269585-00a4-49ff-afd4-1e9efc5e3955 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:18.190918 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-68269585-00a4-49ff-afd4-1e9efc5e3955 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:18.191581 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-68269585-00a4-49ff-afd4-1e9efc5e3955 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:18.192279 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-68269585-00a4-49ff-afd4-1e9efc5e3955 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:18.334835 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-a7d2b8e3-b5b6-494e-9c22-909bf092f62d tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:18.335455 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-a7d2b8e3-b5b6-494e-9c22-909bf092f62d tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: d94a56dc-cb9d-4b55-9f89-b121d45230ca] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:18.362184 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a7d2b8e3-b5b6-494e-9c22-909bf092f62d tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:18.367980 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a7d2b8e3-b5b6-494e-9c22-909bf092f62d tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:18.379201 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a7d2b8e3-b5b6-494e-9c22-909bf092f62d tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:18.379911 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a7d2b8e3-b5b6-494e-9c22-909bf092f62d tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:18.643137 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-a7d2b8e3-b5b6-494e-9c22-909bf092f62d tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:18.652862 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-a7d2b8e3-b5b6-494e-9c22-909bf092f62d tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca" status: 200 len: 1318 microversion: 2.1 time: 0.323336 Apr 30 13:17:18.653696 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 30/79] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:18 2021] GET /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca => generated 1318 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:17:18.658813 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [req-d6089d8b-718c-448b-baad-ca4bd698af93 req-feafebb3-1d44-43b5-922f-b0baf4ec7e41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "272025ed-c9af-4c21-8df7-b4ebc88b96cd", "name": "network-vif-plugged", "status": "completed", "tag": "78b0cb3a-ee36-43df-b7c5-35915a242f36"}]} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:18.660873 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:17:18.660873 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: warnings.warn(msg) Apr 30 13:17:18.670495 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-d6089d8b-718c-448b-baad-ca4bd698af93 req-feafebb3-1d44-43b5-922f-b0baf4ec7e41 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:18.670986 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-d6089d8b-718c-448b-baad-ca4bd698af93 req-feafebb3-1d44-43b5-922f-b0baf4ec7e41 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:18.700671 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.compute.server_external_events [req-d6089d8b-718c-448b-baad-ca4bd698af93 req-feafebb3-1d44-43b5-922f-b0baf4ec7e41 service nova] Creating event network-vif-plugged:78b0cb3a-ee36-43df-b7c5-35915a242f36 for instance 272025ed-c9af-4c21-8df7-b4ebc88b96cd on hv-cinder-78836 Apr 30 13:17:18.707855 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [req-d6089d8b-718c-448b-baad-ca4bd698af93 req-feafebb3-1d44-43b5-922f-b0baf4ec7e41 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052717 Apr 30 13:17:18.708945 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 31/80] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:17:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:17:18.779477 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-68269585-00a4-49ff-afd4-1e9efc5e3955 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7d9d559fcc4228a382dc23989d601e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dda396dc145d58b214518705a9227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:18.788855 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-68269585-00a4-49ff-afd4-1e9efc5e3955 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] 10.222.0.79 "GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd" status: 200 len: 1314 microversion: 2.1 time: 0.623334 Apr 30 13:17:18.789591 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 50/81] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:18 2021] GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd => generated 1314 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:18.872580 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-e4915528-fe8a-4b0d-8506-c27adceb9da0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:18.873556 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-e4915528-fe8a-4b0d-8506-c27adceb9da0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:18.881903 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e4915528-fe8a-4b0d-8506-c27adceb9da0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:18.882404 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e4915528-fe8a-4b0d-8506-c27adceb9da0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:18.883216 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e4915528-fe8a-4b0d-8506-c27adceb9da0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:18.883658 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e4915528-fe8a-4b0d-8506-c27adceb9da0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:19.008426 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-e4915528-fe8a-4b0d-8506-c27adceb9da0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:19.022854 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-e4915528-fe8a-4b0d-8506-c27adceb9da0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:19.025990 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-e4915528-fe8a-4b0d-8506-c27adceb9da0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:19.028002 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-e4915528-fe8a-4b0d-8506-c27adceb9da0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1341 microversion: 2.20 time: 0.160695 Apr 30 13:17:19.029021 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 32/82] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:17:18 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1341 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:17:19.174780 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b0d37ac5-c582-4bfd-8484-3a239865387a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:19.175671 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-b0d37ac5-c582-4bfd-8484-3a239865387a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:19.187157 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b0d37ac5-c582-4bfd-8484-3a239865387a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:19.188898 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b0d37ac5-c582-4bfd-8484-3a239865387a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:19.190180 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b0d37ac5-c582-4bfd-8484-3a239865387a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:19.190939 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b0d37ac5-c582-4bfd-8484-3a239865387a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:19.675810 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-25a2d865-4f78-4a19-9829-de10949969d0 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:19.680828 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-25a2d865-4f78-4a19-9829-de10949969d0 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: d94a56dc-cb9d-4b55-9f89-b121d45230ca] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:19.727693 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-25a2d865-4f78-4a19-9829-de10949969d0 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:19.729817 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-25a2d865-4f78-4a19-9829-de10949969d0 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:19.734626 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-25a2d865-4f78-4a19-9829-de10949969d0 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:19.739456 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-25a2d865-4f78-4a19-9829-de10949969d0 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:20.502519 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-25a2d865-4f78-4a19-9829-de10949969d0 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:20.523729 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-25a2d865-4f78-4a19-9829-de10949969d0 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca" status: 200 len: 1318 microversion: 2.1 time: 0.855607 Apr 30 13:17:20.525854 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 33/83] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:19 2021] GET /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca => generated 1318 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:20.546149 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-5ac3e4fc-18ff-4a65-bf80-7985310f79dc tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:20.547234 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-5ac3e4fc-18ff-4a65-bf80-7985310f79dc tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] [instance: 272025ed-c9af-4c21-8df7-b4ebc88b96cd] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:20.560038 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5ac3e4fc-18ff-4a65-bf80-7985310f79dc tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:20.560901 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5ac3e4fc-18ff-4a65-bf80-7985310f79dc tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:20.562787 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5ac3e4fc-18ff-4a65-bf80-7985310f79dc tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:20.564053 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5ac3e4fc-18ff-4a65-bf80-7985310f79dc tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:20.710615 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-b0d37ac5-c582-4bfd-8484-3a239865387a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:20.735704 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b0d37ac5-c582-4bfd-8484-3a239865387a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1322 microversion: 2.1 time: 1.567627 Apr 30 13:17:20.736703 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 51/84] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:19 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1322 bytes in 1570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:20.741697 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-6ee00cc0-0607-4f6f-9ed3-9789349403ec tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:20.742358 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-6ee00cc0-0607-4f6f-9ed3-9789349403ec tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:20.755977 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6ee00cc0-0607-4f6f-9ed3-9789349403ec tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:20.756458 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6ee00cc0-0607-4f6f-9ed3-9789349403ec tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:20.757292 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6ee00cc0-0607-4f6f-9ed3-9789349403ec tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:20.767066 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6ee00cc0-0607-4f6f-9ed3-9789349403ec tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:20.984211 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-6ee00cc0-0607-4f6f-9ed3-9789349403ec tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:21.007024 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-6ee00cc0-0607-4f6f-9ed3-9789349403ec tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:21.009372 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-6ee00cc0-0607-4f6f-9ed3-9789349403ec tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:21.013460 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-6ee00cc0-0607-4f6f-9ed3-9789349403ec tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1339 microversion: 2.20 time: 0.275417 Apr 30 13:17:21.017207 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 52/85] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:17:20 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1339 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:17:21.027679 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [req-a9c3ba0f-cd9f-41a3-90dc-ea9000e88076 req-193981c2-8cd0-47b0-a0cc-0cc0f10d18f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa7277ee-287a-481c-a0e8-ae4dc4053a0e", "name": "network-vif-plugged", "status": "completed", "tag": "3291dc06-c1f9-4322-b292-ef88b1d2e531"}]} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:21.032180 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:17:21.032180 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: warnings.warn(msg) Apr 30 13:17:21.060288 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-a9c3ba0f-cd9f-41a3-90dc-ea9000e88076 req-193981c2-8cd0-47b0-a0cc-0cc0f10d18f6 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:21.069516 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-a9c3ba0f-cd9f-41a3-90dc-ea9000e88076 req-193981c2-8cd0-47b0-a0cc-0cc0f10d18f6 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:21.101464 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.compute.server_external_events [req-a9c3ba0f-cd9f-41a3-90dc-ea9000e88076 req-193981c2-8cd0-47b0-a0cc-0cc0f10d18f6 service nova] Creating event network-vif-plugged:3291dc06-c1f9-4322-b292-ef88b1d2e531 for instance aa7277ee-287a-481c-a0e8-ae4dc4053a0e on hv-cinder-78836 Apr 30 13:17:21.121355 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [req-a9c3ba0f-cd9f-41a3-90dc-ea9000e88076 req-193981c2-8cd0-47b0-a0cc-0cc0f10d18f6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101714 Apr 30 13:17:21.122930 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 53/86] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:17:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:17:21.374211 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-5ac3e4fc-18ff-4a65-bf80-7985310f79dc tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7d9d559fcc4228a382dc23989d601e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dda396dc145d58b214518705a9227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:21.436446 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-5ac3e4fc-18ff-4a65-bf80-7985310f79dc tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] 10.222.0.79 "GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd" status: 200 len: 1314 microversion: 2.1 time: 0.896964 Apr 30 13:17:21.438061 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 34/87] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:20 2021] GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd => generated 1314 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:21.549204 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-f1dd0b2a-9788-4778-9561-5b5525b78256 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:21.551020 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-f1dd0b2a-9788-4778-9561-5b5525b78256 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: d94a56dc-cb9d-4b55-9f89-b121d45230ca] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:21.575314 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f1dd0b2a-9788-4778-9561-5b5525b78256 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:21.577627 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f1dd0b2a-9788-4778-9561-5b5525b78256 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:21.580171 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f1dd0b2a-9788-4778-9561-5b5525b78256 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:21.585614 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f1dd0b2a-9788-4778-9561-5b5525b78256 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:21.758453 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-8d6de743-e598-448f-bdcc-8483f9414aad tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:21.760033 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-8d6de743-e598-448f-bdcc-8483f9414aad tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:21.779321 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8d6de743-e598-448f-bdcc-8483f9414aad tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:21.780113 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8d6de743-e598-448f-bdcc-8483f9414aad tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:21.783043 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8d6de743-e598-448f-bdcc-8483f9414aad tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:21.783733 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8d6de743-e598-448f-bdcc-8483f9414aad tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:22.240880 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-8d6de743-e598-448f-bdcc-8483f9414aad tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:22.261555 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-8d6de743-e598-448f-bdcc-8483f9414aad tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1322 microversion: 2.1 time: 0.507879 Apr 30 13:17:22.271199 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-f1dd0b2a-9788-4778-9561-5b5525b78256 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:22.273206 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 35/88] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:21 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1322 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:22.280855 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-c9611128-0daf-474f-abdb-be7cd837e40c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:22.282185 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-c9611128-0daf-474f-abdb-be7cd837e40c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:22.288178 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-f1dd0b2a-9788-4778-9561-5b5525b78256 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca" status: 200 len: 1318 microversion: 2.1 time: 0.743964 Apr 30 13:17:22.290069 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 54/89] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:21 2021] GET /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca => generated 1318 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:22.293705 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c9611128-0daf-474f-abdb-be7cd837e40c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:22.294462 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c9611128-0daf-474f-abdb-be7cd837e40c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:22.295439 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c9611128-0daf-474f-abdb-be7cd837e40c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:22.296026 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c9611128-0daf-474f-abdb-be7cd837e40c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:22.454172 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-a529d2d6-4d4d-4e28-87b3-5ab908759e65 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:22.455248 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-a529d2d6-4d4d-4e28-87b3-5ab908759e65 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] [instance: 272025ed-c9af-4c21-8df7-b4ebc88b96cd] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:22.469350 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a529d2d6-4d4d-4e28-87b3-5ab908759e65 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:22.474793 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a529d2d6-4d4d-4e28-87b3-5ab908759e65 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:22.475813 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a529d2d6-4d4d-4e28-87b3-5ab908759e65 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:22.476538 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a529d2d6-4d4d-4e28-87b3-5ab908759e65 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:22.793111 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-c9611128-0daf-474f-abdb-be7cd837e40c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:22.811804 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-c9611128-0daf-474f-abdb-be7cd837e40c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:22.814397 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-c9611128-0daf-474f-abdb-be7cd837e40c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:22.822570 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-c9611128-0daf-474f-abdb-be7cd837e40c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1406 microversion: 2.20 time: 0.544362 Apr 30 13:17:22.827062 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 36/90] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:17:22 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1406 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:17:23.078647 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-a529d2d6-4d4d-4e28-87b3-5ab908759e65 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7d9d559fcc4228a382dc23989d601e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dda396dc145d58b214518705a9227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:23.097322 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-a529d2d6-4d4d-4e28-87b3-5ab908759e65 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] 10.222.0.79 "GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd" status: 200 len: 1314 microversion: 2.1 time: 0.646835 Apr 30 13:17:23.098191 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 55/91] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:22 2021] GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd => generated 1314 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:17:23.279290 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-0bba5c37-07de-4bc1-855f-acd7de15a7cc tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:23.279888 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-0bba5c37-07de-4bc1-855f-acd7de15a7cc tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:23.287831 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0bba5c37-07de-4bc1-855f-acd7de15a7cc tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:23.288289 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0bba5c37-07de-4bc1-855f-acd7de15a7cc tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:23.289087 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0bba5c37-07de-4bc1-855f-acd7de15a7cc tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:23.289529 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0bba5c37-07de-4bc1-855f-acd7de15a7cc tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:23.318221 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-d193e7d0-0787-476c-93e5-0aa5c034a52c tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:23.319585 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-d193e7d0-0787-476c-93e5-0aa5c034a52c tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: d94a56dc-cb9d-4b55-9f89-b121d45230ca] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:23.329984 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d193e7d0-0787-476c-93e5-0aa5c034a52c tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:23.330722 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d193e7d0-0787-476c-93e5-0aa5c034a52c tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:23.331920 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d193e7d0-0787-476c-93e5-0aa5c034a52c tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:23.332764 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d193e7d0-0787-476c-93e5-0aa5c034a52c tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:23.986524 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-d193e7d0-0787-476c-93e5-0aa5c034a52c tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:24.004032 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-d193e7d0-0787-476c-93e5-0aa5c034a52c tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca" status: 200 len: 1318 microversion: 2.1 time: 0.690571 Apr 30 13:17:24.011688 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 56/92] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:23 2021] GET /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca => generated 1318 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:24.023628 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-42c6e4aa-8f30-4d19-ae9c-f235629992c8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:24.025042 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-42c6e4aa-8f30-4d19-ae9c-f235629992c8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:24.046711 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-42c6e4aa-8f30-4d19-ae9c-f235629992c8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:24.047942 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-42c6e4aa-8f30-4d19-ae9c-f235629992c8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:24.049615 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-42c6e4aa-8f30-4d19-ae9c-f235629992c8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:24.050805 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-42c6e4aa-8f30-4d19-ae9c-f235629992c8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:24.239837 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-0bba5c37-07de-4bc1-855f-acd7de15a7cc tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:24.252225 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-0bba5c37-07de-4bc1-855f-acd7de15a7cc tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1322 microversion: 2.1 time: 0.976119 Apr 30 13:17:24.254321 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 37/93] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:23 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1322 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:24.267550 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-5318e9b7-c726-472e-8442-ccb0a9cef435 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:24.268450 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-5318e9b7-c726-472e-8442-ccb0a9cef435 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] [instance: 272025ed-c9af-4c21-8df7-b4ebc88b96cd] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:24.283479 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5318e9b7-c726-472e-8442-ccb0a9cef435 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:24.284319 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5318e9b7-c726-472e-8442-ccb0a9cef435 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:24.285375 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5318e9b7-c726-472e-8442-ccb0a9cef435 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:24.285960 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5318e9b7-c726-472e-8442-ccb0a9cef435 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:24.713206 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-42c6e4aa-8f30-4d19-ae9c-f235629992c8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:24.726682 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-42c6e4aa-8f30-4d19-ae9c-f235629992c8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:24.730536 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-42c6e4aa-8f30-4d19-ae9c-f235629992c8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:24.731878 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-42c6e4aa-8f30-4d19-ae9c-f235629992c8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1406 microversion: 2.20 time: 0.717168 Apr 30 13:17:24.743015 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 57/94] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:17:24 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1406 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:17:25.043937 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-483c22ec-f23e-4f01-949d-fff2294086d1 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:25.045193 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-483c22ec-f23e-4f01-949d-fff2294086d1 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: d94a56dc-cb9d-4b55-9f89-b121d45230ca] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:25.058662 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-483c22ec-f23e-4f01-949d-fff2294086d1 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:25.059361 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-483c22ec-f23e-4f01-949d-fff2294086d1 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:25.060992 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-483c22ec-f23e-4f01-949d-fff2294086d1 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:25.061903 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-483c22ec-f23e-4f01-949d-fff2294086d1 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:25.130713 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-5318e9b7-c726-472e-8442-ccb0a9cef435 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7d9d559fcc4228a382dc23989d601e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dda396dc145d58b214518705a9227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:25.150859 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-5318e9b7-c726-472e-8442-ccb0a9cef435 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] 10.222.0.79 "GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd" status: 200 len: 1502 microversion: 2.1 time: 0.894231 Apr 30 13:17:25.152143 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 38/95] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:24 2021] GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd => generated 1502 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:25.282371 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-b07109ab-c18d-4fcc-bd20-5f044cee5171 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:25.284842 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-b07109ab-c18d-4fcc-bd20-5f044cee5171 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:25.298164 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b07109ab-c18d-4fcc-bd20-5f044cee5171 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:25.299295 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b07109ab-c18d-4fcc-bd20-5f044cee5171 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:25.301035 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b07109ab-c18d-4fcc-bd20-5f044cee5171 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:25.302251 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b07109ab-c18d-4fcc-bd20-5f044cee5171 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:25.489674 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-483c22ec-f23e-4f01-949d-fff2294086d1 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:25.512981 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-483c22ec-f23e-4f01-949d-fff2294086d1 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca" status: 200 len: 1509 microversion: 2.1 time: 0.480946 Apr 30 13:17:25.515752 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 58/96] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:25 2021] GET /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca => generated 1509 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:25.535317 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [req-8a64d621-010d-47c6-bbd3-73ab812692de req-dc0ea4b2-ceba-41da-8f75-32a15eafb104 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad3419a7-71af-4a52-bcb7-6048e0553df9", "tag": "d3c715c3-b0fe-400d-89f5-80c09379ea24"}]} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:25.542052 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:17:25.542052 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: warnings.warn(msg) Apr 30 13:17:25.567694 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-8a64d621-010d-47c6-bbd3-73ab812692de req-dc0ea4b2-ceba-41da-8f75-32a15eafb104 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:25.569381 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-8a64d621-010d-47c6-bbd3-73ab812692de req-dc0ea4b2-ceba-41da-8f75-32a15eafb104 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:25.625536 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.compute.server_external_events [req-8a64d621-010d-47c6-bbd3-73ab812692de req-dc0ea4b2-ceba-41da-8f75-32a15eafb104 service nova] Creating event network-changed:d3c715c3-b0fe-400d-89f5-80c09379ea24 for instance ad3419a7-71af-4a52-bcb7-6048e0553df9 on hv-cinder-78836 Apr 30 13:17:25.649552 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [req-8a64d621-010d-47c6-bbd3-73ab812692de req-dc0ea4b2-ceba-41da-8f75-32a15eafb104 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128721 Apr 30 13:17:25.656141 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 59/97] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:17:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:17:25.753124 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-f21d411d-7f3c-4a82-a879-728ac09f25ba tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:25.753844 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-f21d411d-7f3c-4a82-a879-728ac09f25ba tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:25.769543 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f21d411d-7f3c-4a82-a879-728ac09f25ba tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:25.782191 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f21d411d-7f3c-4a82-a879-728ac09f25ba tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:25.786417 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f21d411d-7f3c-4a82-a879-728ac09f25ba tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:25.788075 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f21d411d-7f3c-4a82-a879-728ac09f25ba tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:26.236105 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-b07109ab-c18d-4fcc-bd20-5f044cee5171 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:26.257533 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-b07109ab-c18d-4fcc-bd20-5f044cee5171 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1322 microversion: 2.1 time: 0.988501 Apr 30 13:17:26.259100 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 39/98] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:25 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1322 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:26.623983 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-f21d411d-7f3c-4a82-a879-728ac09f25ba tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:26.642592 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-f21d411d-7f3c-4a82-a879-728ac09f25ba tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:26.644444 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-f21d411d-7f3c-4a82-a879-728ac09f25ba tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:26.646808 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-f21d411d-7f3c-4a82-a879-728ac09f25ba tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1406 microversion: 2.20 time: 0.899077 Apr 30 13:17:26.660598 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 60/99] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:17:25 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1406 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:17:27.297539 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-a7951137-4c9f-43f5-a596-76f3afbb9560 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:27.298931 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-a7951137-4c9f-43f5-a596-76f3afbb9560 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:27.318630 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a7951137-4c9f-43f5-a596-76f3afbb9560 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:27.319117 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a7951137-4c9f-43f5-a596-76f3afbb9560 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:27.319957 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a7951137-4c9f-43f5-a596-76f3afbb9560 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:27.323815 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a7951137-4c9f-43f5-a596-76f3afbb9560 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:27.438202 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-e76be5b2-695b-4548-976c-49d48a2d3317 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0098ce9-f294-447a-9b0d-29d3ee372e9a"}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:27.439923 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-e76be5b2-695b-4548-976c-49d48a2d3317 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] [instance: 272025ed-c9af-4c21-8df7-b4ebc88b96cd] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:27.466555 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e76be5b2-695b-4548-976c-49d48a2d3317 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:27.467026 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e76be5b2-695b-4548-976c-49d48a2d3317 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:27.467939 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e76be5b2-695b-4548-976c-49d48a2d3317 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:27.468527 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e76be5b2-695b-4548-976c-49d48a2d3317 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:27.986354 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-a7951137-4c9f-43f5-a596-76f3afbb9560 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:28.008409 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-a7951137-4c9f-43f5-a596-76f3afbb9560 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1322 microversion: 2.1 time: 0.729107 Apr 30 13:17:28.011616 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 40/100] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:27 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1322 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:28.045765 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-1fe277bf-9b46-443d-b9ef-4fb93285c5d2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:28.047292 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-1fe277bf-9b46-443d-b9ef-4fb93285c5d2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:28.062722 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1fe277bf-9b46-443d-b9ef-4fb93285c5d2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:28.067014 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1fe277bf-9b46-443d-b9ef-4fb93285c5d2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:28.068787 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1fe277bf-9b46-443d-b9ef-4fb93285c5d2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:28.069848 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1fe277bf-9b46-443d-b9ef-4fb93285c5d2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:28.364006 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-e76be5b2-695b-4548-976c-49d48a2d3317 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] 10.222.0.79 "POST /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.929863 Apr 30 13:17:28.372285 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 61/101] 10.222.0.79 () {60 vars in 1323 bytes} [Fri Apr 30 13:17:27 2021] POST /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd/os-volume_attachments => generated 194 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:17:28.379687 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-5cb040f6-b8ef-43d4-a5e1-1b155b68276d tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40047847-c66a-4761-9d03-52ad034a0282"}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:28.383592 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-5cb040f6-b8ef-43d4-a5e1-1b155b68276d tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: d94a56dc-cb9d-4b55-9f89-b121d45230ca] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:28.411638 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5cb040f6-b8ef-43d4-a5e1-1b155b68276d tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:28.412595 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5cb040f6-b8ef-43d4-a5e1-1b155b68276d tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:28.416162 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5cb040f6-b8ef-43d4-a5e1-1b155b68276d tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:28.417785 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5cb040f6-b8ef-43d4-a5e1-1b155b68276d tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:28.875860 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-1fe277bf-9b46-443d-b9ef-4fb93285c5d2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:28.888632 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-1fe277bf-9b46-443d-b9ef-4fb93285c5d2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:28.891581 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-1fe277bf-9b46-443d-b9ef-4fb93285c5d2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:28.892946 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-1fe277bf-9b46-443d-b9ef-4fb93285c5d2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1406 microversion: 2.20 time: 0.879744 Apr 30 13:17:28.894388 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 41/102] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:17:28 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1406 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:17:29.029896 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-ff25c73c-dcd1-4634-840d-c6e2fcf50e70 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:29.030705 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-ff25c73c-dcd1-4634-840d-c6e2fcf50e70 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:29.044418 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ff25c73c-dcd1-4634-840d-c6e2fcf50e70 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:29.044991 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ff25c73c-dcd1-4634-840d-c6e2fcf50e70 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:29.058643 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ff25c73c-dcd1-4634-840d-c6e2fcf50e70 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:29.059288 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ff25c73c-dcd1-4634-840d-c6e2fcf50e70 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:29.374933 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-ff25c73c-dcd1-4634-840d-c6e2fcf50e70 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:29.411051 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-ff25c73c-dcd1-4634-840d-c6e2fcf50e70 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1322 microversion: 2.1 time: 0.385102 Apr 30 13:17:29.417573 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 42/103] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:29 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1322 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:29.663682 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-5cb040f6-b8ef-43d4-a5e1-1b155b68276d tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "POST /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.293402 Apr 30 13:17:29.666413 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 62/104] 10.222.0.79 () {60 vars in 1323 bytes} [Fri Apr 30 13:17:28 2021] POST /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca/os-volume_attachments => generated 194 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:17:29.917537 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-73f686d8-46ec-45b3-9000-b9655c1af33b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:29.918736 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-73f686d8-46ec-45b3-9000-b9655c1af33b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:29.933494 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-73f686d8-46ec-45b3-9000-b9655c1af33b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:29.934294 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-73f686d8-46ec-45b3-9000-b9655c1af33b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:29.935994 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-73f686d8-46ec-45b3-9000-b9655c1af33b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:29.937263 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-73f686d8-46ec-45b3-9000-b9655c1af33b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:30.231480 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-73f686d8-46ec-45b3-9000-b9655c1af33b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:30.241012 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-73f686d8-46ec-45b3-9000-b9655c1af33b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:30.243029 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-73f686d8-46ec-45b3-9000-b9655c1af33b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:30.244858 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-73f686d8-46ec-45b3-9000-b9655c1af33b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1406 microversion: 2.20 time: 0.336261 Apr 30 13:17:30.245872 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 43/105] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:17:29 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1406 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:17:30.439975 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-027991bb-ab20-4480-9994-5d57d2a727a5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:30.441081 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-027991bb-ab20-4480-9994-5d57d2a727a5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:30.456806 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-027991bb-ab20-4480-9994-5d57d2a727a5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:30.463224 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-027991bb-ab20-4480-9994-5d57d2a727a5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:30.464582 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-027991bb-ab20-4480-9994-5d57d2a727a5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:30.466780 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-027991bb-ab20-4480-9994-5d57d2a727a5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:30.827508 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-027991bb-ab20-4480-9994-5d57d2a727a5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:30.850361 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-027991bb-ab20-4480-9994-5d57d2a727a5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1322 microversion: 2.1 time: 0.416618 Apr 30 13:17:30.851892 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 63/106] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:30 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1322 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:31.264734 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-464d7347-f6b2-4d63-9c1a-f2be65e964f6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:31.265423 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-464d7347-f6b2-4d63-9c1a-f2be65e964f6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:31.280225 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-464d7347-f6b2-4d63-9c1a-f2be65e964f6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:31.281243 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-464d7347-f6b2-4d63-9c1a-f2be65e964f6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:31.282354 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-464d7347-f6b2-4d63-9c1a-f2be65e964f6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:31.283061 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-464d7347-f6b2-4d63-9c1a-f2be65e964f6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:31.522703 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-464d7347-f6b2-4d63-9c1a-f2be65e964f6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:31.537683 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-464d7347-f6b2-4d63-9c1a-f2be65e964f6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:31.539106 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-464d7347-f6b2-4d63-9c1a-f2be65e964f6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:31.541082 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-464d7347-f6b2-4d63-9c1a-f2be65e964f6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1406 microversion: 2.20 time: 0.279702 Apr 30 13:17:31.541650 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 44/107] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:17:31 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1406 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:17:31.868068 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-0e26654b-9c31-4c23-afac-f73f7c81fdd1 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:31.870715 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-0e26654b-9c31-4c23-afac-f73f7c81fdd1 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:31.879925 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0e26654b-9c31-4c23-afac-f73f7c81fdd1 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:31.880648 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0e26654b-9c31-4c23-afac-f73f7c81fdd1 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:31.882114 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0e26654b-9c31-4c23-afac-f73f7c81fdd1 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:31.882752 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0e26654b-9c31-4c23-afac-f73f7c81fdd1 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:32.188685 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-0e26654b-9c31-4c23-afac-f73f7c81fdd1 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:32.199521 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-0e26654b-9c31-4c23-afac-f73f7c81fdd1 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1322 microversion: 2.1 time: 0.335128 Apr 30 13:17:32.200730 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 64/108] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:31 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1322 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:17:32.560566 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-5c0beee9-b406-4ab1-8541-a7b4fccacae5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:32.561786 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-5c0beee9-b406-4ab1-8541-a7b4fccacae5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:32.577710 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5c0beee9-b406-4ab1-8541-a7b4fccacae5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:32.578235 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5c0beee9-b406-4ab1-8541-a7b4fccacae5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:32.578982 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5c0beee9-b406-4ab1-8541-a7b4fccacae5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:32.579421 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5c0beee9-b406-4ab1-8541-a7b4fccacae5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:32.870796 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [req-3c7c4248-e505-4c8a-b936-64d395aba4a7 req-d0c747db-93e5-48da-8f73-181da7cc4b39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad3419a7-71af-4a52-bcb7-6048e0553df9", "name": "network-vif-plugged", "status": "completed", "tag": "d3c715c3-b0fe-400d-89f5-80c09379ea24"}]} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:32.872450 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:17:32.872450 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: warnings.warn(msg) Apr 30 13:17:32.892606 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-3c7c4248-e505-4c8a-b936-64d395aba4a7 req-d0c747db-93e5-48da-8f73-181da7cc4b39 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:32.893056 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-3c7c4248-e505-4c8a-b936-64d395aba4a7 req-d0c747db-93e5-48da-8f73-181da7cc4b39 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:32.937273 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.compute.server_external_events [req-3c7c4248-e505-4c8a-b936-64d395aba4a7 req-d0c747db-93e5-48da-8f73-181da7cc4b39 service nova] Creating event network-vif-plugged:d3c715c3-b0fe-400d-89f5-80c09379ea24 for instance ad3419a7-71af-4a52-bcb7-6048e0553df9 on hv-cinder-78836 Apr 30 13:17:32.937273 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [req-3c7c4248-e505-4c8a-b936-64d395aba4a7 req-d0c747db-93e5-48da-8f73-181da7cc4b39 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071820 Apr 30 13:17:32.948577 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 65/109] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:17:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:17:33.052779 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-5c0beee9-b406-4ab1-8541-a7b4fccacae5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:33.065282 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-5c0beee9-b406-4ab1-8541-a7b4fccacae5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:33.069716 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-5c0beee9-b406-4ab1-8541-a7b4fccacae5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:33.071773 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-5c0beee9-b406-4ab1-8541-a7b4fccacae5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1406 microversion: 2.20 time: 0.515726 Apr 30 13:17:33.072933 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 45/110] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:17:32 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1406 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:17:33.224936 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-c33ff301-d7cb-47f7-abb0-0396541aa6bc tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:33.225740 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-c33ff301-d7cb-47f7-abb0-0396541aa6bc tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:33.239072 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c33ff301-d7cb-47f7-abb0-0396541aa6bc tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:33.240767 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c33ff301-d7cb-47f7-abb0-0396541aa6bc tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:33.242743 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c33ff301-d7cb-47f7-abb0-0396541aa6bc tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:33.243811 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c33ff301-d7cb-47f7-abb0-0396541aa6bc tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:33.535576 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-c33ff301-d7cb-47f7-abb0-0396541aa6bc tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:33.559126 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-c33ff301-d7cb-47f7-abb0-0396541aa6bc tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1322 microversion: 2.1 time: 0.339274 Apr 30 13:17:33.569710 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 66/111] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:33 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1322 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:34.100958 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-7805a6d7-c9f3-4845-8ab0-c4d6135d9974 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:34.104142 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-7805a6d7-c9f3-4845-8ab0-c4d6135d9974 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:34.112509 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7805a6d7-c9f3-4845-8ab0-c4d6135d9974 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:34.113420 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7805a6d7-c9f3-4845-8ab0-c4d6135d9974 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:34.114481 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7805a6d7-c9f3-4845-8ab0-c4d6135d9974 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:34.115014 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7805a6d7-c9f3-4845-8ab0-c4d6135d9974 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:34.388520 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-7805a6d7-c9f3-4845-8ab0-c4d6135d9974 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:34.398085 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-7805a6d7-c9f3-4845-8ab0-c4d6135d9974 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:34.399697 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-7805a6d7-c9f3-4845-8ab0-c4d6135d9974 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:34.401389 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-7805a6d7-c9f3-4845-8ab0-c4d6135d9974 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1406 microversion: 2.20 time: 0.312513 Apr 30 13:17:34.412691 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 46/112] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:17:34 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1406 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:17:34.581688 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-13e4aa62-3b3f-47cf-bf22-8a4ecc93a5d0 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:34.583659 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-13e4aa62-3b3f-47cf-bf22-8a4ecc93a5d0 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:34.593097 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-13e4aa62-3b3f-47cf-bf22-8a4ecc93a5d0 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:34.593679 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-13e4aa62-3b3f-47cf-bf22-8a4ecc93a5d0 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:34.595685 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-13e4aa62-3b3f-47cf-bf22-8a4ecc93a5d0 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:34.595685 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-13e4aa62-3b3f-47cf-bf22-8a4ecc93a5d0 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:34.918332 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-13e4aa62-3b3f-47cf-bf22-8a4ecc93a5d0 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:34.942771 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-13e4aa62-3b3f-47cf-bf22-8a4ecc93a5d0 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1322 microversion: 2.1 time: 0.366974 Apr 30 13:17:34.947155 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 67/113] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:34 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1322 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:34.999523 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [req-0c8155ff-c4ae-4f3b-94f9-8296f525ea6e req-44c8950f-585a-4d0b-9ea9-5e663863bbd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c5fb2f8-696c-48e0-a4f2-c8410fec693f", "name": "network-vif-plugged", "status": "completed", "tag": "3bf7253a-ca9c-4a79-b9c4-d8404a9e675d"}]} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:35.005299 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:17:35.005299 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: warnings.warn(msg) Apr 30 13:17:35.027350 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-0c8155ff-c4ae-4f3b-94f9-8296f525ea6e req-44c8950f-585a-4d0b-9ea9-5e663863bbd9 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:35.027791 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-0c8155ff-c4ae-4f3b-94f9-8296f525ea6e req-44c8950f-585a-4d0b-9ea9-5e663863bbd9 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:35.055139 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.compute.server_external_events [req-0c8155ff-c4ae-4f3b-94f9-8296f525ea6e req-44c8950f-585a-4d0b-9ea9-5e663863bbd9 service nova] Creating event network-vif-plugged:3bf7253a-ca9c-4a79-b9c4-d8404a9e675d for instance 5c5fb2f8-696c-48e0-a4f2-c8410fec693f on hv-cinder-78836 Apr 30 13:17:35.065203 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [req-0c8155ff-c4ae-4f3b-94f9-8296f525ea6e req-44c8950f-585a-4d0b-9ea9-5e663863bbd9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073405 Apr 30 13:17:35.067417 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 47/114] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:17:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:17:35.420540 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-349e0546-9b12-4722-beb9-e99f55c6a82f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:35.421289 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-349e0546-9b12-4722-beb9-e99f55c6a82f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:35.429984 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-349e0546-9b12-4722-beb9-e99f55c6a82f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:35.430431 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-349e0546-9b12-4722-beb9-e99f55c6a82f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:35.431376 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-349e0546-9b12-4722-beb9-e99f55c6a82f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:35.431817 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-349e0546-9b12-4722-beb9-e99f55c6a82f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:35.699620 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-349e0546-9b12-4722-beb9-e99f55c6a82f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:35.715973 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-349e0546-9b12-4722-beb9-e99f55c6a82f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:35.719427 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-349e0546-9b12-4722-beb9-e99f55c6a82f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:35.722278 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-349e0546-9b12-4722-beb9-e99f55c6a82f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1406 microversion: 2.20 time: 0.305474 Apr 30 13:17:35.724068 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 68/115] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:17:35 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1406 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:17:35.968429 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-206717f8-f213-43c2-9678-702d9bd2f29d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:35.969973 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-206717f8-f213-43c2-9678-702d9bd2f29d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:35.979523 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-206717f8-f213-43c2-9678-702d9bd2f29d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:35.980801 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-206717f8-f213-43c2-9678-702d9bd2f29d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:35.980801 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-206717f8-f213-43c2-9678-702d9bd2f29d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:35.982753 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-206717f8-f213-43c2-9678-702d9bd2f29d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:36.301778 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-206717f8-f213-43c2-9678-702d9bd2f29d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:36.313603 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-206717f8-f213-43c2-9678-702d9bd2f29d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1322 microversion: 2.1 time: 0.349047 Apr 30 13:17:36.314502 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 48/116] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:35 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1322 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:36.743601 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-7be6203f-489e-4127-b1ab-b1eedb0fa083 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:36.745378 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-7be6203f-489e-4127-b1ab-b1eedb0fa083 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:36.754220 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7be6203f-489e-4127-b1ab-b1eedb0fa083 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:36.754684 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7be6203f-489e-4127-b1ab-b1eedb0fa083 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:36.755727 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7be6203f-489e-4127-b1ab-b1eedb0fa083 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:36.756069 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7be6203f-489e-4127-b1ab-b1eedb0fa083 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:37.046265 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-7be6203f-489e-4127-b1ab-b1eedb0fa083 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:37.057360 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-7be6203f-489e-4127-b1ab-b1eedb0fa083 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:37.059217 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-7be6203f-489e-4127-b1ab-b1eedb0fa083 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:37.060576 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-7be6203f-489e-4127-b1ab-b1eedb0fa083 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1406 microversion: 2.20 time: 0.322982 Apr 30 13:17:37.061278 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 69/117] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:17:36 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1406 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:17:37.332150 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-8690927e-a851-493b-a80b-7312ad30dc95 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:37.333479 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-8690927e-a851-493b-a80b-7312ad30dc95 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:37.348454 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8690927e-a851-493b-a80b-7312ad30dc95 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:37.348916 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8690927e-a851-493b-a80b-7312ad30dc95 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:37.349797 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8690927e-a851-493b-a80b-7312ad30dc95 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:37.350358 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8690927e-a851-493b-a80b-7312ad30dc95 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:37.638684 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-8690927e-a851-493b-a80b-7312ad30dc95 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:37.648443 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-8690927e-a851-493b-a80b-7312ad30dc95 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1322 microversion: 2.1 time: 0.320489 Apr 30 13:17:37.649029 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 49/118] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:37 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1322 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:38.083228 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-3460dfb1-99a8-41e4-8f58-adbfe44441cc tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:38.084181 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-3460dfb1-99a8-41e4-8f58-adbfe44441cc tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:38.093102 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3460dfb1-99a8-41e4-8f58-adbfe44441cc tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:38.093718 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3460dfb1-99a8-41e4-8f58-adbfe44441cc tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:38.094594 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3460dfb1-99a8-41e4-8f58-adbfe44441cc tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:38.095035 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3460dfb1-99a8-41e4-8f58-adbfe44441cc tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:38.471636 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-3460dfb1-99a8-41e4-8f58-adbfe44441cc tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:38.485003 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-3460dfb1-99a8-41e4-8f58-adbfe44441cc tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:38.487306 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-3460dfb1-99a8-41e4-8f58-adbfe44441cc tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:38.488484 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-3460dfb1-99a8-41e4-8f58-adbfe44441cc tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1406 microversion: 2.20 time: 0.412163 Apr 30 13:17:38.489077 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 70/119] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:17:38 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1406 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:17:38.678410 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-59bff054-22ff-4f8c-8131-3dc3c9b82c00 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:38.693092 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-59bff054-22ff-4f8c-8131-3dc3c9b82c00 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:38.714448 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-59bff054-22ff-4f8c-8131-3dc3c9b82c00 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:38.715324 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-59bff054-22ff-4f8c-8131-3dc3c9b82c00 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:38.716165 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-59bff054-22ff-4f8c-8131-3dc3c9b82c00 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:38.716606 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-59bff054-22ff-4f8c-8131-3dc3c9b82c00 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:39.043849 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-59bff054-22ff-4f8c-8131-3dc3c9b82c00 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:39.064182 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-59bff054-22ff-4f8c-8131-3dc3c9b82c00 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1322 microversion: 2.1 time: 0.398476 Apr 30 13:17:39.064668 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 50/120] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:38 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1322 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:39.508310 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b90b02d8-4b82-47ac-990f-ed00c1067730 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:39.510154 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-b90b02d8-4b82-47ac-990f-ed00c1067730 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:39.518172 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b90b02d8-4b82-47ac-990f-ed00c1067730 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:39.518731 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b90b02d8-4b82-47ac-990f-ed00c1067730 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:39.519647 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b90b02d8-4b82-47ac-990f-ed00c1067730 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:39.520184 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b90b02d8-4b82-47ac-990f-ed00c1067730 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:39.785925 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-b90b02d8-4b82-47ac-990f-ed00c1067730 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:39.797888 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-b90b02d8-4b82-47ac-990f-ed00c1067730 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:39.799916 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-b90b02d8-4b82-47ac-990f-ed00c1067730 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:39.801530 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b90b02d8-4b82-47ac-990f-ed00c1067730 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1597 microversion: 2.20 time: 0.296966 Apr 30 13:17:39.829656 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-8e0bb909-9330-438e-a93b-e686d03cc28c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:39.830209 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-8e0bb909-9330-438e-a93b-e686d03cc28c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:39.834591 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 71/121] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:17:39 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1597 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:17:39.840532 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8e0bb909-9330-438e-a93b-e686d03cc28c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:39.841265 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8e0bb909-9330-438e-a93b-e686d03cc28c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:39.842253 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8e0bb909-9330-438e-a93b-e686d03cc28c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:39.842841 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8e0bb909-9330-438e-a93b-e686d03cc28c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:40.043070 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-8e0bb909-9330-438e-a93b-e686d03cc28c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.224919 Apr 30 13:17:40.043868 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 51/122] 10.222.0.79 () {60 vars in 1316 bytes} [Fri Apr 30 13:17:39 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/os-interface => generated 284 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:17:40.082748 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-1f5faa9f-c01b-4b58-b25b-9ff2aef34a95 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:40.083363 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-1f5faa9f-c01b-4b58-b25b-9ff2aef34a95 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:40.092076 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1f5faa9f-c01b-4b58-b25b-9ff2aef34a95 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:40.092833 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1f5faa9f-c01b-4b58-b25b-9ff2aef34a95 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:40.093848 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1f5faa9f-c01b-4b58-b25b-9ff2aef34a95 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:40.094504 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1f5faa9f-c01b-4b58-b25b-9ff2aef34a95 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:40.727842 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-1f5faa9f-c01b-4b58-b25b-9ff2aef34a95 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:40.737518 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-1f5faa9f-c01b-4b58-b25b-9ff2aef34a95 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1322 microversion: 2.1 time: 0.658413 Apr 30 13:17:40.739929 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 72/123] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:40 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1322 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:17:41.756654 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-82d10eda-d7dc-4364-b950-5f5eca3b9df1 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:41.757540 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-82d10eda-d7dc-4364-b950-5f5eca3b9df1 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:41.767481 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-82d10eda-d7dc-4364-b950-5f5eca3b9df1 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:41.769132 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-82d10eda-d7dc-4364-b950-5f5eca3b9df1 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:41.771453 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-82d10eda-d7dc-4364-b950-5f5eca3b9df1 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:41.772380 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-82d10eda-d7dc-4364-b950-5f5eca3b9df1 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:42.125899 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-82d10eda-d7dc-4364-b950-5f5eca3b9df1 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:42.140727 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-82d10eda-d7dc-4364-b950-5f5eca3b9df1 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1515 microversion: 2.1 time: 0.384610 Apr 30 13:17:42.141514 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 52/124] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:41 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1515 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:17:42.169846 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-995cb429-221a-4fb4-9e13-3c46d0eebe8d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:42.170979 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-995cb429-221a-4fb4-9e13-3c46d0eebe8d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:42.181899 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-995cb429-221a-4fb4-9e13-3c46d0eebe8d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:42.182397 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-995cb429-221a-4fb4-9e13-3c46d0eebe8d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:42.183205 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-995cb429-221a-4fb4-9e13-3c46d0eebe8d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:42.183647 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-995cb429-221a-4fb4-9e13-3c46d0eebe8d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:42.244590 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.objects.instance [None req-995cb429-221a-4fb4-9e13-3c46d0eebe8d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lazy-loading 'flavor' on Instance uuid 5c5fb2f8-696c-48e0-a4f2-c8410fec693f {{(pid=87933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:17:42.405023 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-995cb429-221a-4fb4-9e13-3c46d0eebe8d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "POST /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f/action" status: 200 len: 32 microversion: 2.1 time: 0.235213 Apr 30 13:17:42.405023 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 73/125] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:17:42 2021] POST /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f/action => generated 32 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 13:17:42.410199 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-eb43e67e-3cea-49a9-b8f4-92e7519c222a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:42.410828 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-eb43e67e-3cea-49a9-b8f4-92e7519c222a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:42.419780 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-eb43e67e-3cea-49a9-b8f4-92e7519c222a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:42.420242 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-eb43e67e-3cea-49a9-b8f4-92e7519c222a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:42.421048 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-eb43e67e-3cea-49a9-b8f4-92e7519c222a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:42.421495 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-eb43e67e-3cea-49a9-b8f4-92e7519c222a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:42.652887 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-eb43e67e-3cea-49a9-b8f4-92e7519c222a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:42.665392 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-eb43e67e-3cea-49a9-b8f4-92e7519c222a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1521 microversion: 2.1 time: 0.258769 Apr 30 13:17:42.676801 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 53/126] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:42 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:42.684444 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-3d415146-8928-4f1b-93ab-5196162c1a77 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:42.686077 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-3d415146-8928-4f1b-93ab-5196162c1a77 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:42.686331 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [req-823f5d29-eff1-402b-99d2-c3fd0e56945e req-6185e71f-701a-4162-bdcf-480a5525d401 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad3419a7-71af-4a52-bcb7-6048e0553df9", "tag": "d3c715c3-b0fe-400d-89f5-80c09379ea24"}]} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:42.689127 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:17:42.689127 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: warnings.warn(msg) Apr 30 13:17:42.699895 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3d415146-8928-4f1b-93ab-5196162c1a77 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:42.700615 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3d415146-8928-4f1b-93ab-5196162c1a77 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:42.701889 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3d415146-8928-4f1b-93ab-5196162c1a77 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:42.702643 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3d415146-8928-4f1b-93ab-5196162c1a77 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:42.705420 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-823f5d29-eff1-402b-99d2-c3fd0e56945e req-6185e71f-701a-4162-bdcf-480a5525d401 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:42.706198 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-823f5d29-eff1-402b-99d2-c3fd0e56945e req-6185e71f-701a-4162-bdcf-480a5525d401 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:42.738398 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.compute.server_external_events [req-823f5d29-eff1-402b-99d2-c3fd0e56945e req-6185e71f-701a-4162-bdcf-480a5525d401 service nova] Creating event network-changed:d3c715c3-b0fe-400d-89f5-80c09379ea24 for instance ad3419a7-71af-4a52-bcb7-6048e0553df9 on hv-cinder-78836 Apr 30 13:17:42.747669 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [req-823f5d29-eff1-402b-99d2-c3fd0e56945e req-6185e71f-701a-4162-bdcf-480a5525d401 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068306 Apr 30 13:17:42.752037 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 54/127] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:17:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:17:43.685462 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-1add613b-5dda-4d48-8fb7-48346160a7e4 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:43.686400 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-1add613b-5dda-4d48-8fb7-48346160a7e4 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:43.694425 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1add613b-5dda-4d48-8fb7-48346160a7e4 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:43.694884 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1add613b-5dda-4d48-8fb7-48346160a7e4 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:43.695845 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1add613b-5dda-4d48-8fb7-48346160a7e4 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:43.696776 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1add613b-5dda-4d48-8fb7-48346160a7e4 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:43.974048 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-1add613b-5dda-4d48-8fb7-48346160a7e4 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:43.983735 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-1add613b-5dda-4d48-8fb7-48346160a7e4 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1521 microversion: 2.1 time: 0.302394 Apr 30 13:17:43.984546 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 55/128] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:43 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:17:45.001595 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-8e5e773c-04e4-4ea0-89b9-411a3fd19e6c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:45.002690 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-8e5e773c-04e4-4ea0-89b9-411a3fd19e6c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:45.010980 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8e5e773c-04e4-4ea0-89b9-411a3fd19e6c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:45.011491 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8e5e773c-04e4-4ea0-89b9-411a3fd19e6c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:45.012448 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8e5e773c-04e4-4ea0-89b9-411a3fd19e6c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:45.012894 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8e5e773c-04e4-4ea0-89b9-411a3fd19e6c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:45.281999 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-3d415146-8928-4f1b-93ab-5196162c1a77 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action" status: 200 len: 14 microversion: 2.20 time: 2.605368 Apr 30 13:17:45.283901 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 74/129] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:17:42 2021] POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action => generated 14 bytes in 2609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:45.454557 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-8e5e773c-04e4-4ea0-89b9-411a3fd19e6c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:45.502252 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-8e5e773c-04e4-4ea0-89b9-411a3fd19e6c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1521 microversion: 2.1 time: 0.504250 Apr 30 13:17:45.503353 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 56/130] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:44 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1521 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:17:46.296911 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-ee36211d-ed0b-4f02-b56d-3400bcec3b25 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:46.298455 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-ee36211d-ed0b-4f02-b56d-3400bcec3b25 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:46.306768 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ee36211d-ed0b-4f02-b56d-3400bcec3b25 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:46.307227 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ee36211d-ed0b-4f02-b56d-3400bcec3b25 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:46.308037 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ee36211d-ed0b-4f02-b56d-3400bcec3b25 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:46.308481 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ee36211d-ed0b-4f02-b56d-3400bcec3b25 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:46.520824 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-99b36c66-72c8-47f0-bef3-61c2fbcc3a22 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:46.521513 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-99b36c66-72c8-47f0-bef3-61c2fbcc3a22 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:46.529325 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-99b36c66-72c8-47f0-bef3-61c2fbcc3a22 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:46.529776 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-99b36c66-72c8-47f0-bef3-61c2fbcc3a22 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:46.530590 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-99b36c66-72c8-47f0-bef3-61c2fbcc3a22 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:46.531027 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-99b36c66-72c8-47f0-bef3-61c2fbcc3a22 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:46.608477 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-ee36211d-ed0b-4f02-b56d-3400bcec3b25 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action" status: 200 len: 14 microversion: 2.20 time: 0.315958 Apr 30 13:17:46.609307 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 75/131] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:17:46 2021] POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action => generated 14 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:46.617512 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-22d46336-50c1-49d7-b99d-e82f0e128385 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:46.619044 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-22d46336-50c1-49d7-b99d-e82f0e128385 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] [instance: 272025ed-c9af-4c21-8df7-b4ebc88b96cd] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:46.629210 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-22d46336-50c1-49d7-b99d-e82f0e128385 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:46.629913 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-22d46336-50c1-49d7-b99d-e82f0e128385 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:46.630757 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-22d46336-50c1-49d7-b99d-e82f0e128385 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:46.631419 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-22d46336-50c1-49d7-b99d-e82f0e128385 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:46.700184 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-22d46336-50c1-49d7-b99d-e82f0e128385 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] [instance: 272025ed-c9af-4c21-8df7-b4ebc88b96cd] Going to try to terminate instance {{(pid=87933) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 13:17:46.875144 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-22d46336-50c1-49d7-b99d-e82f0e128385 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] 10.222.0.79 "DELETE /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd" status: 204 len: 0 microversion: 2.1 time: 0.259800 Apr 30 13:17:46.878149 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 76/132] 10.222.0.79 () {58 vars in 1239 bytes} [Fri Apr 30 13:17:46 2021] DELETE /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 13:17:46.894354 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-3af4e063-14e1-41be-bf79-06b1644f4458 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:46.895346 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-3af4e063-14e1-41be-bf79-06b1644f4458 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] [instance: 272025ed-c9af-4c21-8df7-b4ebc88b96cd] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:46.905670 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3af4e063-14e1-41be-bf79-06b1644f4458 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:46.906393 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3af4e063-14e1-41be-bf79-06b1644f4458 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:46.907919 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3af4e063-14e1-41be-bf79-06b1644f4458 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:46.908673 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3af4e063-14e1-41be-bf79-06b1644f4458 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:47.194604 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-3af4e063-14e1-41be-bf79-06b1644f4458 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7d9d559fcc4228a382dc23989d601e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dda396dc145d58b214518705a9227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:47.206396 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-3af4e063-14e1-41be-bf79-06b1644f4458 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] 10.222.0.79 "GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd" status: 200 len: 1554 microversion: 2.1 time: 0.319440 Apr 30 13:17:47.207508 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 77/133] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:46 2021] GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd => generated 1554 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:47.232599 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-99b36c66-72c8-47f0-bef3-61c2fbcc3a22 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:47.242037 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-99b36c66-72c8-47f0-bef3-61c2fbcc3a22 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1521 microversion: 2.1 time: 0.725111 Apr 30 13:17:47.243220 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 57/134] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:46 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1521 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:17:47.620533 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-fe706c61-a568-437f-8e74-0709483beca4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:47.621523 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-fe706c61-a568-437f-8e74-0709483beca4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:47.632505 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-fe706c61-a568-437f-8e74-0709483beca4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:47.632962 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-fe706c61-a568-437f-8e74-0709483beca4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:47.634617 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-fe706c61-a568-437f-8e74-0709483beca4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:47.635042 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-fe706c61-a568-437f-8e74-0709483beca4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:47.985831 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-fe706c61-a568-437f-8e74-0709483beca4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action" status: 200 len: 14 microversion: 2.20 time: 0.369936 Apr 30 13:17:47.986824 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 78/135] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:17:47 2021] POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action => generated 14 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:48.234704 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-7dfaba81-4a60-4fad-b13d-21c85f7b32a9 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:48.235342 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-7dfaba81-4a60-4fad-b13d-21c85f7b32a9 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] [instance: 272025ed-c9af-4c21-8df7-b4ebc88b96cd] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:48.243396 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7dfaba81-4a60-4fad-b13d-21c85f7b32a9 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:48.243851 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7dfaba81-4a60-4fad-b13d-21c85f7b32a9 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:48.244659 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7dfaba81-4a60-4fad-b13d-21c85f7b32a9 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:48.245102 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7dfaba81-4a60-4fad-b13d-21c85f7b32a9 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:48.260490 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-c6584dcf-96d0-4d30-84fb-6d0c600de2e9 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:48.261451 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-c6584dcf-96d0-4d30-84fb-6d0c600de2e9 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:48.269622 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c6584dcf-96d0-4d30-84fb-6d0c600de2e9 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:48.270195 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c6584dcf-96d0-4d30-84fb-6d0c600de2e9 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:48.271138 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c6584dcf-96d0-4d30-84fb-6d0c600de2e9 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:48.271642 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c6584dcf-96d0-4d30-84fb-6d0c600de2e9 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:48.501148 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-7dfaba81-4a60-4fad-b13d-21c85f7b32a9 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7d9d559fcc4228a382dc23989d601e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dda396dc145d58b214518705a9227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:48.511538 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-7dfaba81-4a60-4fad-b13d-21c85f7b32a9 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] 10.222.0.79 "GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd" status: 200 len: 1554 microversion: 2.1 time: 0.290167 Apr 30 13:17:48.512123 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 58/136] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:48 2021] GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd => generated 1554 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:48.516870 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-c6584dcf-96d0-4d30-84fb-6d0c600de2e9 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:48.526324 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-c6584dcf-96d0-4d30-84fb-6d0c600de2e9 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1521 microversion: 2.1 time: 0.270139 Apr 30 13:17:48.526901 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 79/137] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:48 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:17:48.997213 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-dd1db2de-c20e-401b-9a53-973d6d00676f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:48.998113 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-dd1db2de-c20e-401b-9a53-973d6d00676f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:49.005765 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-dd1db2de-c20e-401b-9a53-973d6d00676f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:49.006291 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-dd1db2de-c20e-401b-9a53-973d6d00676f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:49.007138 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-dd1db2de-c20e-401b-9a53-973d6d00676f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:49.007530 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-dd1db2de-c20e-401b-9a53-973d6d00676f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:49.528690 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-376ecd17-992a-4368-a785-ae28ec6e4886 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:49.529306 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-376ecd17-992a-4368-a785-ae28ec6e4886 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] [instance: 272025ed-c9af-4c21-8df7-b4ebc88b96cd] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:49.537375 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-376ecd17-992a-4368-a785-ae28ec6e4886 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:49.537771 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-376ecd17-992a-4368-a785-ae28ec6e4886 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:49.538602 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-376ecd17-992a-4368-a785-ae28ec6e4886 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:49.539042 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-376ecd17-992a-4368-a785-ae28ec6e4886 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:49.742387 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-376ecd17-992a-4368-a785-ae28ec6e4886 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7d9d559fcc4228a382dc23989d601e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dda396dc145d58b214518705a9227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:49.752215 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-376ecd17-992a-4368-a785-ae28ec6e4886 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] 10.222.0.79 "GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd" status: 200 len: 1554 microversion: 2.1 time: 0.227212 Apr 30 13:17:49.753064 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 80/138] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:49 2021] GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd => generated 1554 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:17:49.757473 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-cb79b210-db81-4470-bdf7-b84580e9b511 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:49.758099 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-cb79b210-db81-4470-bdf7-b84580e9b511 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:49.765264 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-cb79b210-db81-4470-bdf7-b84580e9b511 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:49.765715 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-cb79b210-db81-4470-bdf7-b84580e9b511 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:49.766524 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-cb79b210-db81-4470-bdf7-b84580e9b511 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:49.766979 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-cb79b210-db81-4470-bdf7-b84580e9b511 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:50.044439 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-cb79b210-db81-4470-bdf7-b84580e9b511 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:50.053566 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-cb79b210-db81-4470-bdf7-b84580e9b511 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1521 microversion: 2.1 time: 0.299433 Apr 30 13:17:50.054191 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 81/139] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:49 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:50.770036 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-7b69c231-3942-4146-b448-f2aa59c4284b tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:50.770719 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-7b69c231-3942-4146-b448-f2aa59c4284b tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] [instance: 272025ed-c9af-4c21-8df7-b4ebc88b96cd] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:50.778383 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7b69c231-3942-4146-b448-f2aa59c4284b tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:50.778831 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7b69c231-3942-4146-b448-f2aa59c4284b tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:50.779613 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7b69c231-3942-4146-b448-f2aa59c4284b tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:50.780045 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7b69c231-3942-4146-b448-f2aa59c4284b tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:51.001592 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-7b69c231-3942-4146-b448-f2aa59c4284b tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7d9d559fcc4228a382dc23989d601e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dda396dc145d58b214518705a9227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:51.011688 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-7b69c231-3942-4146-b448-f2aa59c4284b tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] 10.222.0.79 "GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd" status: 200 len: 1554 microversion: 2.1 time: 0.245366 Apr 30 13:17:51.012275 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 82/140] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:50 2021] GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd => generated 1554 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:17:51.070857 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-15d2d808-11d3-40e5-a086-2083f85a8bed tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:51.071448 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-15d2d808-11d3-40e5-a086-2083f85a8bed tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:51.079390 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-15d2d808-11d3-40e5-a086-2083f85a8bed tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:51.079891 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-15d2d808-11d3-40e5-a086-2083f85a8bed tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:51.080983 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-15d2d808-11d3-40e5-a086-2083f85a8bed tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:51.081483 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-15d2d808-11d3-40e5-a086-2083f85a8bed tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:51.294751 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-15d2d808-11d3-40e5-a086-2083f85a8bed tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:51.304074 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-15d2d808-11d3-40e5-a086-2083f85a8bed tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1521 microversion: 2.1 time: 0.236972 Apr 30 13:17:51.304692 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 83/141] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:51 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:17:52.029380 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-20aec386-d7e7-4002-8c03-c062e9c02e76 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:52.030059 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-20aec386-d7e7-4002-8c03-c062e9c02e76 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] [instance: 272025ed-c9af-4c21-8df7-b4ebc88b96cd] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:52.039120 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-20aec386-d7e7-4002-8c03-c062e9c02e76 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:52.039603 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-20aec386-d7e7-4002-8c03-c062e9c02e76 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:52.040633 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-20aec386-d7e7-4002-8c03-c062e9c02e76 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:52.041087 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-20aec386-d7e7-4002-8c03-c062e9c02e76 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:52.256472 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-dd1db2de-c20e-401b-9a53-973d6d00676f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action" status: 200 len: 14 microversion: 2.20 time: 3.263122 Apr 30 13:17:52.259318 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 59/142] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:17:48 2021] POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action => generated 14 bytes in 3265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:52.261860 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-20aec386-d7e7-4002-8c03-c062e9c02e76 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7d9d559fcc4228a382dc23989d601e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dda396dc145d58b214518705a9227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:52.271628 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-20aec386-d7e7-4002-8c03-c062e9c02e76 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] 10.222.0.79 "GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd" status: 200 len: 1554 microversion: 2.1 time: 0.245973 Apr 30 13:17:52.272335 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 84/143] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:52 2021] GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd => generated 1554 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:52.323697 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-7a4f7bce-48b1-47db-bee3-239acbef5772 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:52.324530 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-7a4f7bce-48b1-47db-bee3-239acbef5772 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:52.333773 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7a4f7bce-48b1-47db-bee3-239acbef5772 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:52.334255 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7a4f7bce-48b1-47db-bee3-239acbef5772 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:52.335055 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7a4f7bce-48b1-47db-bee3-239acbef5772 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:52.335497 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7a4f7bce-48b1-47db-bee3-239acbef5772 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:52.653667 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-7a4f7bce-48b1-47db-bee3-239acbef5772 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:52.662588 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-7a4f7bce-48b1-47db-bee3-239acbef5772 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1521 microversion: 2.1 time: 0.343821 Apr 30 13:17:52.663168 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 60/144] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:52 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1521 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:53.268758 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-2b297378-ca28-40c5-a492-244b92d0284d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:53.269702 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-2b297378-ca28-40c5-a492-244b92d0284d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:53.277604 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2b297378-ca28-40c5-a492-244b92d0284d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:53.278083 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2b297378-ca28-40c5-a492-244b92d0284d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:53.278881 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2b297378-ca28-40c5-a492-244b92d0284d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:53.279316 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2b297378-ca28-40c5-a492-244b92d0284d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:53.290696 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-66d3dfe0-0e22-40a3-960f-093c359276f6 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:53.291572 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-66d3dfe0-0e22-40a3-960f-093c359276f6 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] [instance: 272025ed-c9af-4c21-8df7-b4ebc88b96cd] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:53.299796 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-66d3dfe0-0e22-40a3-960f-093c359276f6 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:53.300673 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-66d3dfe0-0e22-40a3-960f-093c359276f6 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:53.301596 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-66d3dfe0-0e22-40a3-960f-093c359276f6 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:53.302174 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-66d3dfe0-0e22-40a3-960f-093c359276f6 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:53.456319 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-2b297378-ca28-40c5-a492-244b92d0284d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action" status: 200 len: 14 microversion: 2.20 time: 0.191001 Apr 30 13:17:53.457254 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 85/145] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:17:53 2021] POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action => generated 14 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:53.573687 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-66d3dfe0-0e22-40a3-960f-093c359276f6 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7d9d559fcc4228a382dc23989d601e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dda396dc145d58b214518705a9227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:53.589514 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-66d3dfe0-0e22-40a3-960f-093c359276f6 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] 10.222.0.79 "GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd" status: 200 len: 1554 microversion: 2.1 time: 0.303641 Apr 30 13:17:53.590545 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 61/146] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:53 2021] GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd => generated 1554 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:17:53.679796 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-9113b9aa-a36a-48f0-b67f-746a9e341257 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:53.680642 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-9113b9aa-a36a-48f0-b67f-746a9e341257 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:53.688731 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9113b9aa-a36a-48f0-b67f-746a9e341257 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:53.689192 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9113b9aa-a36a-48f0-b67f-746a9e341257 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:53.690024 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9113b9aa-a36a-48f0-b67f-746a9e341257 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:53.690476 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9113b9aa-a36a-48f0-b67f-746a9e341257 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:53.899459 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-9113b9aa-a36a-48f0-b67f-746a9e341257 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:53.908355 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-9113b9aa-a36a-48f0-b67f-746a9e341257 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1521 microversion: 2.1 time: 0.232584 Apr 30 13:17:53.908941 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 86/147] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:53 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:54.468460 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-c5a84879-92bd-4eb8-808c-5d615d371fad tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:54.469481 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-c5a84879-92bd-4eb8-808c-5d615d371fad tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:54.477651 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c5a84879-92bd-4eb8-808c-5d615d371fad tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:54.478137 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c5a84879-92bd-4eb8-808c-5d615d371fad tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:54.478940 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c5a84879-92bd-4eb8-808c-5d615d371fad tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:54.479436 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c5a84879-92bd-4eb8-808c-5d615d371fad tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:54.608212 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-4d4a9d55-687f-4efd-9c30-91f11ba8a82f tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:54.608831 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-4d4a9d55-687f-4efd-9c30-91f11ba8a82f tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] [instance: 272025ed-c9af-4c21-8df7-b4ebc88b96cd] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:54.616353 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4d4a9d55-687f-4efd-9c30-91f11ba8a82f tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:54.616810 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4d4a9d55-687f-4efd-9c30-91f11ba8a82f tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:54.617691 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4d4a9d55-687f-4efd-9c30-91f11ba8a82f tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:54.618188 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4d4a9d55-687f-4efd-9c30-91f11ba8a82f tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:54.825617 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-4d4a9d55-687f-4efd-9c30-91f11ba8a82f tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7d9d559fcc4228a382dc23989d601e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dda396dc145d58b214518705a9227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:54.834814 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-4d4a9d55-687f-4efd-9c30-91f11ba8a82f tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] 10.222.0.79 "GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd" status: 200 len: 1554 microversion: 2.1 time: 0.230339 Apr 30 13:17:54.835395 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 87/148] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:54 2021] GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd => generated 1554 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:17:54.925243 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-12f8420d-21d8-4bbe-aa20-191aa867c838 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:54.925858 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-12f8420d-21d8-4bbe-aa20-191aa867c838 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:54.933731 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-12f8420d-21d8-4bbe-aa20-191aa867c838 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:54.934224 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-12f8420d-21d8-4bbe-aa20-191aa867c838 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:54.935017 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-12f8420d-21d8-4bbe-aa20-191aa867c838 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:54.935453 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-12f8420d-21d8-4bbe-aa20-191aa867c838 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:55.137362 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-12f8420d-21d8-4bbe-aa20-191aa867c838 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:55.145754 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-12f8420d-21d8-4bbe-aa20-191aa867c838 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1521 microversion: 2.1 time: 0.224478 Apr 30 13:17:55.146351 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 88/149] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:54 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:17:55.852501 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b980b3ab-b255-4a9e-89b1-8f74948ddad0 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:55.853235 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-b980b3ab-b255-4a9e-89b1-8f74948ddad0 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] [instance: 272025ed-c9af-4c21-8df7-b4ebc88b96cd] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:55.860754 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b980b3ab-b255-4a9e-89b1-8f74948ddad0 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:55.861201 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b980b3ab-b255-4a9e-89b1-8f74948ddad0 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:55.861994 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b980b3ab-b255-4a9e-89b1-8f74948ddad0 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:55.863021 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b980b3ab-b255-4a9e-89b1-8f74948ddad0 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:56.071647 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-b980b3ab-b255-4a9e-89b1-8f74948ddad0 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7d9d559fcc4228a382dc23989d601e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dda396dc145d58b214518705a9227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:56.080804 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b980b3ab-b255-4a9e-89b1-8f74948ddad0 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] 10.222.0.79 "GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd" status: 200 len: 1554 microversion: 2.1 time: 0.232109 Apr 30 13:17:56.081456 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 89/150] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:55 2021] GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd => generated 1554 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:17:56.163065 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-e0121285-b521-493d-9843-229e0879fc94 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:56.163756 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-e0121285-b521-493d-9843-229e0879fc94 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:56.171746 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e0121285-b521-493d-9843-229e0879fc94 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:56.172201 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e0121285-b521-493d-9843-229e0879fc94 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:56.173053 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e0121285-b521-493d-9843-229e0879fc94 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:56.173528 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e0121285-b521-493d-9843-229e0879fc94 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:56.377795 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-e0121285-b521-493d-9843-229e0879fc94 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:56.386185 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-e0121285-b521-493d-9843-229e0879fc94 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1521 microversion: 2.1 time: 0.227052 Apr 30 13:17:56.386763 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 90/151] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:56 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:17:57.097476 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-ac205868-df5a-4a3b-acfb-22ead75189ca tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:57.098135 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-ac205868-df5a-4a3b-acfb-22ead75189ca tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] [instance: 272025ed-c9af-4c21-8df7-b4ebc88b96cd] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:57.106809 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ac205868-df5a-4a3b-acfb-22ead75189ca tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:57.107265 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ac205868-df5a-4a3b-acfb-22ead75189ca tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:57.108070 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ac205868-df5a-4a3b-acfb-22ead75189ca tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:57.108519 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ac205868-df5a-4a3b-acfb-22ead75189ca tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:57.144914 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-c5a84879-92bd-4eb8-808c-5d615d371fad tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action" status: 200 len: 14 microversion: 2.20 time: 2.679987 Apr 30 13:17:57.145563 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 62/152] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:17:54 2021] POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action => generated 14 bytes in 2682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:57.312705 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-ac205868-df5a-4a3b-acfb-22ead75189ca tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7d9d559fcc4228a382dc23989d601e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dda396dc145d58b214518705a9227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:57.322515 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-ac205868-df5a-4a3b-acfb-22ead75189ca tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] 10.222.0.79 "GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd" status: 200 len: 1554 microversion: 2.1 time: 0.228636 Apr 30 13:17:57.323089 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 91/153] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:57 2021] GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd => generated 1554 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:17:57.404505 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-a16a0f10-cc32-4f03-9747-2fe535c77f5c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:57.405116 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-a16a0f10-cc32-4f03-9747-2fe535c77f5c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:57.413415 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a16a0f10-cc32-4f03-9747-2fe535c77f5c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:57.413870 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a16a0f10-cc32-4f03-9747-2fe535c77f5c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:57.415333 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a16a0f10-cc32-4f03-9747-2fe535c77f5c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:57.415773 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a16a0f10-cc32-4f03-9747-2fe535c77f5c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:57.616298 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-a16a0f10-cc32-4f03-9747-2fe535c77f5c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:57.624946 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-a16a0f10-cc32-4f03-9747-2fe535c77f5c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1521 microversion: 2.1 time: 0.224731 Apr 30 13:17:57.625513 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 63/154] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:57 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:58.157015 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-085890b2-a1aa-42e3-bcc2-cf62561f5d86 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:58.157931 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-085890b2-a1aa-42e3-bcc2-cf62561f5d86 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:58.167262 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-085890b2-a1aa-42e3-bcc2-cf62561f5d86 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:58.167792 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-085890b2-a1aa-42e3-bcc2-cf62561f5d86 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:58.168647 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-085890b2-a1aa-42e3-bcc2-cf62561f5d86 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:58.169162 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-085890b2-a1aa-42e3-bcc2-cf62561f5d86 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:58.340999 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-a0794202-4910-4475-8b7d-a53a4ae8fa3a tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:58.341631 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-a0794202-4910-4475-8b7d-a53a4ae8fa3a tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] [instance: 272025ed-c9af-4c21-8df7-b4ebc88b96cd] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:58.349454 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a0794202-4910-4475-8b7d-a53a4ae8fa3a tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:58.349921 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a0794202-4910-4475-8b7d-a53a4ae8fa3a tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:58.350753 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a0794202-4910-4475-8b7d-a53a4ae8fa3a tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:58.351377 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a0794202-4910-4475-8b7d-a53a4ae8fa3a tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:58.359858 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-085890b2-a1aa-42e3-bcc2-cf62561f5d86 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action" status: 200 len: 14 microversion: 2.20 time: 0.206013 Apr 30 13:17:58.363813 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 92/155] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:17:58 2021] POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action => generated 14 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:58.647053 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-7e6966a6-a5c8-4590-ad43-74bf8bf2ede9 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:58.649498 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-7e6966a6-a5c8-4590-ad43-74bf8bf2ede9 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:58.660423 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7e6966a6-a5c8-4590-ad43-74bf8bf2ede9 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:58.661395 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7e6966a6-a5c8-4590-ad43-74bf8bf2ede9 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:58.662701 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7e6966a6-a5c8-4590-ad43-74bf8bf2ede9 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:58.663926 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7e6966a6-a5c8-4590-ad43-74bf8bf2ede9 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:58.732346 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-a0794202-4910-4475-8b7d-a53a4ae8fa3a tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7d9d559fcc4228a382dc23989d601e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dda396dc145d58b214518705a9227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:58.747941 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-a0794202-4910-4475-8b7d-a53a4ae8fa3a tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] 10.222.0.79 "GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd" status: 200 len: 1554 microversion: 2.1 time: 0.412097 Apr 30 13:17:58.749282 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 64/156] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:58 2021] GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd => generated 1554 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:58.943475 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-7e6966a6-a5c8-4590-ad43-74bf8bf2ede9 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:58.952658 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-7e6966a6-a5c8-4590-ad43-74bf8bf2ede9 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1521 microversion: 2.1 time: 0.314390 Apr 30 13:17:58.953247 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 93/157] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:58 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1521 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:17:59.373914 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-1fd78e72-9825-443e-8079-40483d5a8602 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:59.389000 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-1fd78e72-9825-443e-8079-40483d5a8602 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:59.404075 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1fd78e72-9825-443e-8079-40483d5a8602 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:59.405498 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1fd78e72-9825-443e-8079-40483d5a8602 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:59.406492 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1fd78e72-9825-443e-8079-40483d5a8602 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:59.407253 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1fd78e72-9825-443e-8079-40483d5a8602 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:59.567075 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [req-320ac93f-85e9-4689-b957-62d79112c47d req-650df573-7443-4125-bbda-43cac15a5088 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "272025ed-c9af-4c21-8df7-b4ebc88b96cd", "name": "network-vif-deleted", "tag": "78b0cb3a-ee36-43df-b7c5-35915a242f36"}]} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:17:59.569587 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:17:59.569587 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: warnings.warn(msg) Apr 30 13:17:59.581067 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-320ac93f-85e9-4689-b957-62d79112c47d req-650df573-7443-4125-bbda-43cac15a5088 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:59.581695 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-320ac93f-85e9-4689-b957-62d79112c47d req-650df573-7443-4125-bbda-43cac15a5088 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:59.588181 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-1fd78e72-9825-443e-8079-40483d5a8602 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action" status: 200 len: 14 microversion: 2.20 time: 0.219143 Apr 30 13:17:59.590478 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 65/158] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:17:59 2021] POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action => generated 14 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:59.603025 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.compute.server_external_events [req-320ac93f-85e9-4689-b957-62d79112c47d req-650df573-7443-4125-bbda-43cac15a5088 service nova] Creating event network-vif-deleted:78b0cb3a-ee36-43df-b7c5-35915a242f36 for instance 272025ed-c9af-4c21-8df7-b4ebc88b96cd on hv-cinder-78836 Apr 30 13:17:59.611086 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [req-320ac93f-85e9-4689-b957-62d79112c47d req-650df573-7443-4125-bbda-43cac15a5088 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047181 Apr 30 13:17:59.612269 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 94/159] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:17:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:17:59.765903 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-0a842cec-a532-4bfe-b6eb-12d27a8c5e51 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:59.766908 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-0a842cec-a532-4bfe-b6eb-12d27a8c5e51 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] [instance: 272025ed-c9af-4c21-8df7-b4ebc88b96cd] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:59.784259 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0a842cec-a532-4bfe-b6eb-12d27a8c5e51 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:59.784859 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0a842cec-a532-4bfe-b6eb-12d27a8c5e51 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:59.785814 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0a842cec-a532-4bfe-b6eb-12d27a8c5e51 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:59.787136 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0a842cec-a532-4bfe-b6eb-12d27a8c5e51 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:59.958259 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-0a842cec-a532-4bfe-b6eb-12d27a8c5e51 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7d9d559fcc4228a382dc23989d601e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dda396dc145d58b214518705a9227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:17:59.970160 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-0a842cec-a532-4bfe-b6eb-12d27a8c5e51 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] 10.222.0.79 "GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd" status: 200 len: 1345 microversion: 2.1 time: 0.208327 Apr 30 13:17:59.971523 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 66/160] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:59 2021] GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd => generated 1345 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:17:59.971643 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-74a53981-acc0-4ac8-8598-4ac29dffd9f5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:17:59.972276 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-74a53981-acc0-4ac8-8598-4ac29dffd9f5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:17:59.981509 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-74a53981-acc0-4ac8-8598-4ac29dffd9f5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:59.981959 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-74a53981-acc0-4ac8-8598-4ac29dffd9f5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:17:59.982805 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-74a53981-acc0-4ac8-8598-4ac29dffd9f5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:17:59.983264 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-74a53981-acc0-4ac8-8598-4ac29dffd9f5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:00.206531 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-74a53981-acc0-4ac8-8598-4ac29dffd9f5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:00.215819 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-74a53981-acc0-4ac8-8598-4ac29dffd9f5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1521 microversion: 2.1 time: 0.248938 Apr 30 13:18:00.216670 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 95/161] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:17:59 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:18:00.599759 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-b033ef44-6c2f-402c-937e-834763798c4d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:18:00.600745 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-b033ef44-6c2f-402c-937e-834763798c4d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:00.608387 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b033ef44-6c2f-402c-937e-834763798c4d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:00.608836 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b033ef44-6c2f-402c-937e-834763798c4d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:00.609619 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b033ef44-6c2f-402c-937e-834763798c4d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:00.610073 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b033ef44-6c2f-402c-937e-834763798c4d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:00.836194 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-b033ef44-6c2f-402c-937e-834763798c4d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action" status: 200 len: 4832 microversion: 2.20 time: 0.240351 Apr 30 13:18:00.839779 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 67/162] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:18:00 2021] POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action => generated 4832 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:18:00.988491 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-8c28a99a-2bec-495f-8daf-477369fbff8f tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:00.989179 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-8c28a99a-2bec-495f-8daf-477369fbff8f tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] [instance: 272025ed-c9af-4c21-8df7-b4ebc88b96cd] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:00.998559 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8c28a99a-2bec-495f-8daf-477369fbff8f tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:00.999268 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8c28a99a-2bec-495f-8daf-477369fbff8f tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:01.000174 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8c28a99a-2bec-495f-8daf-477369fbff8f tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:01.000761 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8c28a99a-2bec-495f-8daf-477369fbff8f tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:01.077957 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8c28a99a-2bec-495f-8daf-477369fbff8f tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:01.078449 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8c28a99a-2bec-495f-8daf-477369fbff8f tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:01.079102 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.objects.instance [None req-8c28a99a-2bec-495f-8daf-477369fbff8f tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lazy-loading 'fault' on Instance uuid 272025ed-c9af-4c21-8df7-b4ebc88b96cd {{(pid=87933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:18:01.142298 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-8c28a99a-2bec-495f-8daf-477369fbff8f tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab7d9d559fcc4228a382dc23989d601e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799dda396dc145d58b214518705a9227', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:01.153720 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-8c28a99a-2bec-495f-8daf-477369fbff8f tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] 10.222.0.79 "GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd" status: 200 len: 1350 microversion: 2.1 time: 0.167632 Apr 30 13:18:01.153720 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 96/163] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:00 2021] GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd => generated 1350 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:01.234946 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-81a5dbe3-e3ad-4b98-a806-3a94c07f6a5f tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:01.235692 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-81a5dbe3-e3ad-4b98-a806-3a94c07f6a5f tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:01.244320 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-81a5dbe3-e3ad-4b98-a806-3a94c07f6a5f tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:01.244958 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-81a5dbe3-e3ad-4b98-a806-3a94c07f6a5f tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:01.245835 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-81a5dbe3-e3ad-4b98-a806-3a94c07f6a5f tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:01.246411 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-81a5dbe3-e3ad-4b98-a806-3a94c07f6a5f tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:01.466989 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-81a5dbe3-e3ad-4b98-a806-3a94c07f6a5f tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:01.480575 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-81a5dbe3-e3ad-4b98-a806-3a94c07f6a5f tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1521 microversion: 2.1 time: 0.249819 Apr 30 13:18:01.481560 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 68/164] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:01 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:01.847553 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-1b95f284-843f-4a4b-b1cc-708b826b040f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:18:01.859188 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-1b95f284-843f-4a4b-b1cc-708b826b040f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:01.868338 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1b95f284-843f-4a4b-b1cc-708b826b040f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:01.869078 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1b95f284-843f-4a4b-b1cc-708b826b040f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:01.870123 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1b95f284-843f-4a4b-b1cc-708b826b040f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:01.870725 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1b95f284-843f-4a4b-b1cc-708b826b040f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:02.171387 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-ceb2d445-1c3e-48cb-885a-da8ce0453cc2 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:02.172177 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-ceb2d445-1c3e-48cb-885a-da8ce0453cc2 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] [instance: 272025ed-c9af-4c21-8df7-b4ebc88b96cd] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:02.181499 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ceb2d445-1c3e-48cb-885a-da8ce0453cc2 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:02.182235 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ceb2d445-1c3e-48cb-885a-da8ce0453cc2 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:02.183048 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ceb2d445-1c3e-48cb-885a-da8ce0453cc2 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:02.183498 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ceb2d445-1c3e-48cb-885a-da8ce0453cc2 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:02.237024 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.wsgi [None req-ceb2d445-1c3e-48cb-885a-da8ce0453cc2 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] HTTP exception thrown: Instance 272025ed-c9af-4c21-8df7-b4ebc88b96cd could not be found. Apr 30 13:18:02.237645 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-ceb2d445-1c3e-48cb-885a-da8ce0453cc2 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Returning 404 to user: Instance 272025ed-c9af-4c21-8df7-b4ebc88b96cd could not be found. {{(pid=87932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:18:02.238538 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-ceb2d445-1c3e-48cb-885a-da8ce0453cc2 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] 10.222.0.79 "GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd" status: 404 len: 111 microversion: 2.1 time: 0.071683 Apr 30 13:18:02.239102 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 69/165] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:02 2021] GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 13:18:02.499351 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-d82b0bbb-3745-4a1a-97f8-876ef7a19e46 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:02.500613 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-d82b0bbb-3745-4a1a-97f8-876ef7a19e46 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:02.510890 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d82b0bbb-3745-4a1a-97f8-876ef7a19e46 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:02.511444 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d82b0bbb-3745-4a1a-97f8-876ef7a19e46 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:02.512350 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d82b0bbb-3745-4a1a-97f8-876ef7a19e46 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:02.512873 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d82b0bbb-3745-4a1a-97f8-876ef7a19e46 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:02.956212 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-d82b0bbb-3745-4a1a-97f8-876ef7a19e46 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:02.966812 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-d82b0bbb-3745-4a1a-97f8-876ef7a19e46 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1521 microversion: 2.1 time: 0.471117 Apr 30 13:18:02.967320 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 70/166] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:02 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1521 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:18:03.984903 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-6647d8cf-4841-41e7-bc54-5490a513feec tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:03.985762 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-6647d8cf-4841-41e7-bc54-5490a513feec tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:04.003727 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6647d8cf-4841-41e7-bc54-5490a513feec tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:04.003828 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6647d8cf-4841-41e7-bc54-5490a513feec tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:04.004928 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6647d8cf-4841-41e7-bc54-5490a513feec tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:04.005045 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6647d8cf-4841-41e7-bc54-5490a513feec tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:04.245082 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-6647d8cf-4841-41e7-bc54-5490a513feec tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:04.255351 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-6647d8cf-4841-41e7-bc54-5490a513feec tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1521 microversion: 2.1 time: 0.275024 Apr 30 13:18:04.256524 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 71/167] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:03 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:05.254041 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-1b95f284-843f-4a4b-b1cc-708b826b040f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action" status: 200 len: 15064 microversion: 2.20 time: 3.410081 Apr 30 13:18:05.255522 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 97/168] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:18:01 2021] POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action => generated 15064 bytes in 3412 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 30 13:18:05.281070 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-6edb619c-2b7a-422f-9e52-dc112db9d42b tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:05.282158 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-6edb619c-2b7a-422f-9e52-dc112db9d42b tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:05.291502 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6edb619c-2b7a-422f-9e52-dc112db9d42b tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:05.291987 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6edb619c-2b7a-422f-9e52-dc112db9d42b tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:05.292846 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6edb619c-2b7a-422f-9e52-dc112db9d42b tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:05.293377 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6edb619c-2b7a-422f-9e52-dc112db9d42b tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:05.641258 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-6edb619c-2b7a-422f-9e52-dc112db9d42b tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:05.650849 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-6edb619c-2b7a-422f-9e52-dc112db9d42b tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1521 microversion: 2.1 time: 0.373690 Apr 30 13:18:05.651475 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 72/169] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:05 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1521 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:18:06.269497 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-70791287-0651-4dd2-a299-43f09c698b70 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:18:06.270809 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-70791287-0651-4dd2-a299-43f09c698b70 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:06.282174 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-70791287-0651-4dd2-a299-43f09c698b70 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:06.282684 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-70791287-0651-4dd2-a299-43f09c698b70 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:06.283569 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-70791287-0651-4dd2-a299-43f09c698b70 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:06.284059 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-70791287-0651-4dd2-a299-43f09c698b70 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:06.441796 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-70791287-0651-4dd2-a299-43f09c698b70 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action" status: 200 len: 17834 microversion: 2.20 time: 0.177340 Apr 30 13:18:06.442831 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 98/170] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:18:06 2021] POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action => generated 17834 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:18:06.669259 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-d831fb60-d96d-4561-a5d9-a88c921f2c69 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:06.670209 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-d831fb60-d96d-4561-a5d9-a88c921f2c69 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:06.681011 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d831fb60-d96d-4561-a5d9-a88c921f2c69 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:06.681011 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d831fb60-d96d-4561-a5d9-a88c921f2c69 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:06.681011 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d831fb60-d96d-4561-a5d9-a88c921f2c69 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:06.681325 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d831fb60-d96d-4561-a5d9-a88c921f2c69 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:06.930735 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-d831fb60-d96d-4561-a5d9-a88c921f2c69 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:06.943734 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-d831fb60-d96d-4561-a5d9-a88c921f2c69 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1521 microversion: 2.1 time: 0.278994 Apr 30 13:18:06.944322 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 73/171] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:06 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:07.165487 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-86361df7-5f7a-43ec-a13b-fd88aa040f63 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:07.166235 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-86361df7-5f7a-43ec-a13b-fd88aa040f63 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] [instance: 272025ed-c9af-4c21-8df7-b4ebc88b96cd] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:07.174736 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-86361df7-5f7a-43ec-a13b-fd88aa040f63 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:07.175111 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-86361df7-5f7a-43ec-a13b-fd88aa040f63 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:07.176154 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-86361df7-5f7a-43ec-a13b-fd88aa040f63 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:07.176603 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-86361df7-5f7a-43ec-a13b-fd88aa040f63 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:07.232472 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.wsgi [None req-86361df7-5f7a-43ec-a13b-fd88aa040f63 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] HTTP exception thrown: Instance 272025ed-c9af-4c21-8df7-b4ebc88b96cd could not be found. Apr 30 13:18:07.233094 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-86361df7-5f7a-43ec-a13b-fd88aa040f63 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Returning 404 to user: Instance 272025ed-c9af-4c21-8df7-b4ebc88b96cd could not be found. {{(pid=87933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:18:07.233957 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-86361df7-5f7a-43ec-a13b-fd88aa040f63 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] 10.222.0.79 "DELETE /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd" status: 404 len: 111 microversion: 2.1 time: 0.073841 Apr 30 13:18:07.234553 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 99/172] 10.222.0.79 () {58 vars in 1239 bytes} [Fri Apr 30 13:18:07 2021] DELETE /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:18:07.247334 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-a47fd528-4fea-4c39-b46e-5fe40eab3da3 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:07.250170 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-a47fd528-4fea-4c39-b46e-5fe40eab3da3 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] [instance: 272025ed-c9af-4c21-8df7-b4ebc88b96cd] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:07.267058 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a47fd528-4fea-4c39-b46e-5fe40eab3da3 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:07.268617 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a47fd528-4fea-4c39-b46e-5fe40eab3da3 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:07.270379 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a47fd528-4fea-4c39-b46e-5fe40eab3da3 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:07.271520 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a47fd528-4fea-4c39-b46e-5fe40eab3da3 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:07.383551 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.wsgi [None req-a47fd528-4fea-4c39-b46e-5fe40eab3da3 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] HTTP exception thrown: Instance 272025ed-c9af-4c21-8df7-b4ebc88b96cd could not be found. Apr 30 13:18:07.384687 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-a47fd528-4fea-4c39-b46e-5fe40eab3da3 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] Returning 404 to user: Instance 272025ed-c9af-4c21-8df7-b4ebc88b96cd could not be found. {{(pid=87932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:18:07.385887 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-a47fd528-4fea-4c39-b46e-5fe40eab3da3 tempest-DeleteServersTestJSON-281500164 tempest-DeleteServersTestJSON-281500164-project] 10.222.0.79 "GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd" status: 404 len: 111 microversion: 2.1 time: 0.146222 Apr 30 13:18:07.386786 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 74/173] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:07 2021] GET /compute/v2.1/servers/272025ed-c9af-4c21-8df7-b4ebc88b96cd => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:18:07.455898 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-fa80379a-d5eb-447b-95ad-3fa33f557c03 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:18:07.456998 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-fa80379a-d5eb-447b-95ad-3fa33f557c03 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:07.474066 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-fa80379a-d5eb-447b-95ad-3fa33f557c03 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:07.474992 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-fa80379a-d5eb-447b-95ad-3fa33f557c03 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:07.476180 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-fa80379a-d5eb-447b-95ad-3fa33f557c03 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:07.478153 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-fa80379a-d5eb-447b-95ad-3fa33f557c03 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:07.495503 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-b8b885a6-db60-4516-9e8c-fe25f6c93a04 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-596121798", "imageRef": "705a0c6b-b003-4687-84bf-8b9f87dae39e", "flavorRef": "452", "networks": [{"uuid": "4f6ff428-220c-464d-bf3c-450653cf4660"}]}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:18:07.646955 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.network.neutron [None req-b8b885a6-db60-4516-9e8c-fe25f6c93a04 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] validate_networks() for [('4f6ff428-220c-464d-bf3c-450653cf4660', None, None, None)] {{(pid=87932) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 13:18:07.717244 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-fa80379a-d5eb-447b-95ad-3fa33f557c03 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action" status: 200 len: 17933 microversion: 2.20 time: 0.267532 Apr 30 13:18:07.721736 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 100/174] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:18:07 2021] POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action => generated 17933 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:18:07.973980 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-9da55d0b-acd6-4f30-a941-8f1ea0426c60 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:07.978366 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-9da55d0b-acd6-4f30-a941-8f1ea0426c60 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:08.030568 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9da55d0b-acd6-4f30-a941-8f1ea0426c60 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:08.039454 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9da55d0b-acd6-4f30-a941-8f1ea0426c60 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:08.047632 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9da55d0b-acd6-4f30-a941-8f1ea0426c60 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:08.048640 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9da55d0b-acd6-4f30-a941-8f1ea0426c60 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:08.492057 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-b8b885a6-db60-4516-9e8c-fe25f6c93a04 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Flavor limits 0:0:0 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 13:18:08.493135 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-b8b885a6-db60-4516-9e8c-fe25f6c93a04 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Image limits 0:0:0 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 13:18:08.493913 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-b8b885a6-db60-4516-9e8c-fe25f6c93a04 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Flavor pref 0:0:0 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 13:18:08.494712 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-b8b885a6-db60-4516-9e8c-fe25f6c93a04 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Image pref 0:0:0 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 13:18:08.495338 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-b8b885a6-db60-4516-9e8c-fe25f6c93a04 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 13:18:08.516537 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b8b885a6-db60-4516-9e8c-fe25f6c93a04 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:08.517063 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b8b885a6-db60-4516-9e8c-fe25f6c93a04 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:08.520351 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b8b885a6-db60-4516-9e8c-fe25f6c93a04 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:08.520939 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b8b885a6-db60-4516-9e8c-fe25f6c93a04 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:08.600846 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.quota [None req-b8b885a6-db60-4516-9e8c-fe25f6c93a04 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Getting quotas for project f8dcaa02d735401891147a4c2464e318. Resources: {'ram', 'instances', 'cores'} {{(pid=87932) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:18:08.606603 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.quota [None req-b8b885a6-db60-4516-9e8c-fe25f6c93a04 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Getting quotas for user f2a53be36b2d4d6681dacffb5843510f and project f8dcaa02d735401891147a4c2464e318. Resources: {'ram', 'instances', 'cores'} {{(pid=87932) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:18:08.623516 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-b8b885a6-db60-4516-9e8c-fe25f6c93a04 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Going to run 1 instances... {{(pid=87932) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 13:18:08.626564 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-b8b885a6-db60-4516-9e8c-fe25f6c93a04 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 725460b8-1eec-40a7-948f-6a7c80ebfd3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='705a0c6b-b003-4687-84bf-8b9f87dae39e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=87932) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 13:18:08.692359 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-b8b885a6-db60-4516-9e8c-fe25f6c93a04 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.200900 Apr 30 13:18:08.693335 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 75/175] 10.222.0.79 () {60 vars in 1147 bytes} [Fri Apr 30 13:18:07 2021] POST /compute/v2.1/servers => generated 380 bytes in 1203 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 30 13:18:08.706235 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-e51f4622-81f2-4108-af66-316f619eade7 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:08.707243 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-e51f4622-81f2-4108-af66-316f619eade7 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 725460b8-1eec-40a7-948f-6a7c80ebfd3b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:08.877705 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-e51f4622-81f2-4108-af66-316f619eade7 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:08.902215 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-e51f4622-81f2-4108-af66-316f619eade7 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/725460b8-1eec-40a7-948f-6a7c80ebfd3b" status: 200 len: 1217 microversion: 2.1 time: 0.199112 Apr 30 13:18:08.912311 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 76/176] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:08 2021] GET /compute/v2.1/servers/725460b8-1eec-40a7-948f-6a7c80ebfd3b => generated 1217 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:08.920541 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-b959b6f9-ed4c-4634-a018-0afa9a4c6124 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:18:08.921794 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-b959b6f9-ed4c-4634-a018-0afa9a4c6124 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:08.932423 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b959b6f9-ed4c-4634-a018-0afa9a4c6124 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:08.933335 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b959b6f9-ed4c-4634-a018-0afa9a4c6124 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:08.934366 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b959b6f9-ed4c-4634-a018-0afa9a4c6124 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:08.934950 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b959b6f9-ed4c-4634-a018-0afa9a4c6124 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:09.101000 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-9da55d0b-acd6-4f30-a941-8f1ea0426c60 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:09.135284 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-9da55d0b-acd6-4f30-a941-8f1ea0426c60 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1521 microversion: 2.1 time: 1.176400 Apr 30 13:18:09.135892 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 101/177] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:07 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1521 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:09.918994 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-e48ddc19-3d43-48cc-a428-e079d9d4fd65 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:09.919741 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-e48ddc19-3d43-48cc-a428-e079d9d4fd65 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 725460b8-1eec-40a7-948f-6a7c80ebfd3b] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:09.927119 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e48ddc19-3d43-48cc-a428-e079d9d4fd65 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:09.927829 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e48ddc19-3d43-48cc-a428-e079d9d4fd65 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:09.928619 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e48ddc19-3d43-48cc-a428-e079d9d4fd65 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:09.929212 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e48ddc19-3d43-48cc-a428-e079d9d4fd65 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:10.056667 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-e48ddc19-3d43-48cc-a428-e079d9d4fd65 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:10.066937 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-e48ddc19-3d43-48cc-a428-e079d9d4fd65 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/725460b8-1eec-40a7-948f-6a7c80ebfd3b" status: 200 len: 1221 microversion: 2.1 time: 0.151327 Apr 30 13:18:10.074149 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 102/178] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:09 2021] GET /compute/v2.1/servers/725460b8-1eec-40a7-948f-6a7c80ebfd3b => generated 1221 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:18:10.155150 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-56f2d804-265b-4226-8216-f0fbc4963046 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:10.155783 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-56f2d804-265b-4226-8216-f0fbc4963046 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:10.164387 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-56f2d804-265b-4226-8216-f0fbc4963046 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:10.164841 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-56f2d804-265b-4226-8216-f0fbc4963046 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:10.165631 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-56f2d804-265b-4226-8216-f0fbc4963046 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:10.166166 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-56f2d804-265b-4226-8216-f0fbc4963046 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:10.383940 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-56f2d804-265b-4226-8216-f0fbc4963046 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:10.392991 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-56f2d804-265b-4226-8216-f0fbc4963046 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1521 microversion: 2.1 time: 0.241472 Apr 30 13:18:10.393701 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 103/179] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:10 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:11.085031 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-4df4499f-7b19-4880-a12d-b2d0688b8cac tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:11.086893 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-4df4499f-7b19-4880-a12d-b2d0688b8cac tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 725460b8-1eec-40a7-948f-6a7c80ebfd3b] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:11.095113 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4df4499f-7b19-4880-a12d-b2d0688b8cac tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:11.095643 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4df4499f-7b19-4880-a12d-b2d0688b8cac tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:11.096578 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4df4499f-7b19-4880-a12d-b2d0688b8cac tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:11.097397 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4df4499f-7b19-4880-a12d-b2d0688b8cac tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:11.246637 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-4df4499f-7b19-4880-a12d-b2d0688b8cac tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:11.255529 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-4df4499f-7b19-4880-a12d-b2d0688b8cac tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/725460b8-1eec-40a7-948f-6a7c80ebfd3b" status: 200 len: 1221 microversion: 2.1 time: 0.174482 Apr 30 13:18:11.256015 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 104/180] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:11 2021] GET /compute/v2.1/servers/725460b8-1eec-40a7-948f-6a7c80ebfd3b => generated 1221 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:18:11.392598 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-b959b6f9-ed4c-4634-a018-0afa9a4c6124 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action" status: 200 len: 23883 microversion: 2.20 time: 2.478419 Apr 30 13:18:11.393915 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 77/181] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:18:08 2021] POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action => generated 23883 bytes in 2481 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:18:11.410200 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-516f3329-da38-48bf-a043-a83ce39b4fae tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:11.411145 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-516f3329-da38-48bf-a043-a83ce39b4fae tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:11.421563 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-516f3329-da38-48bf-a043-a83ce39b4fae tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:11.422514 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-516f3329-da38-48bf-a043-a83ce39b4fae tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:11.423735 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-516f3329-da38-48bf-a043-a83ce39b4fae tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:11.424387 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-516f3329-da38-48bf-a043-a83ce39b4fae tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:11.832965 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-516f3329-da38-48bf-a043-a83ce39b4fae tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:11.847443 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-516f3329-da38-48bf-a043-a83ce39b4fae tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1521 microversion: 2.1 time: 0.440920 Apr 30 13:18:11.854959 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 105/182] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:11 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1521 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:12.274270 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-01765657-d32a-4b30-8f4e-10d529914cd5 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:12.280768 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-01765657-d32a-4b30-8f4e-10d529914cd5 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 725460b8-1eec-40a7-948f-6a7c80ebfd3b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:12.291724 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-01765657-d32a-4b30-8f4e-10d529914cd5 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:12.292474 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-01765657-d32a-4b30-8f4e-10d529914cd5 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:12.293455 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-01765657-d32a-4b30-8f4e-10d529914cd5 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:12.294392 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-01765657-d32a-4b30-8f4e-10d529914cd5 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:12.407028 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-179c7f86-2485-49f2-8470-5f05f1273268 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:18:12.408243 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-179c7f86-2485-49f2-8470-5f05f1273268 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:12.416324 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-179c7f86-2485-49f2-8470-5f05f1273268 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:12.417064 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-179c7f86-2485-49f2-8470-5f05f1273268 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:12.418094 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-179c7f86-2485-49f2-8470-5f05f1273268 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:12.418739 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-179c7f86-2485-49f2-8470-5f05f1273268 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:12.465952 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-01765657-d32a-4b30-8f4e-10d529914cd5 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:12.475402 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-01765657-d32a-4b30-8f4e-10d529914cd5 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/725460b8-1eec-40a7-948f-6a7c80ebfd3b" status: 200 len: 1269 microversion: 2.1 time: 0.206034 Apr 30 13:18:12.477079 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 78/183] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:12 2021] GET /compute/v2.1/servers/725460b8-1eec-40a7-948f-6a7c80ebfd3b => generated 1269 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:12.871681 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-02862254-ea48-4511-84f0-faa085bcbd20 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:12.872621 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-02862254-ea48-4511-84f0-faa085bcbd20 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:12.881603 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-02862254-ea48-4511-84f0-faa085bcbd20 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:12.884743 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-02862254-ea48-4511-84f0-faa085bcbd20 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:12.885617 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-02862254-ea48-4511-84f0-faa085bcbd20 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:12.886176 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-02862254-ea48-4511-84f0-faa085bcbd20 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:13.106708 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-02862254-ea48-4511-84f0-faa085bcbd20 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:13.115337 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-02862254-ea48-4511-84f0-faa085bcbd20 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1521 microversion: 2.1 time: 0.248426 Apr 30 13:18:13.115906 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 79/184] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:12 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:18:13.493830 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-718b2b4e-f863-49b8-b85c-ca93b600be05 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:13.494466 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-718b2b4e-f863-49b8-b85c-ca93b600be05 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 725460b8-1eec-40a7-948f-6a7c80ebfd3b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:13.502584 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-718b2b4e-f863-49b8-b85c-ca93b600be05 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:13.503138 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-718b2b4e-f863-49b8-b85c-ca93b600be05 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:13.503937 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-718b2b4e-f863-49b8-b85c-ca93b600be05 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:13.504379 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-718b2b4e-f863-49b8-b85c-ca93b600be05 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:13.623069 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-718b2b4e-f863-49b8-b85c-ca93b600be05 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:13.631407 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-718b2b4e-f863-49b8-b85c-ca93b600be05 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/725460b8-1eec-40a7-948f-6a7c80ebfd3b" status: 200 len: 1269 microversion: 2.1 time: 0.141657 Apr 30 13:18:13.631966 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 80/185] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:13 2021] GET /compute/v2.1/servers/725460b8-1eec-40a7-948f-6a7c80ebfd3b => generated 1269 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:18:14.133720 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-21e2e2ac-3fde-4fe8-9582-3892f7110146 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:14.134795 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-21e2e2ac-3fde-4fe8-9582-3892f7110146 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:14.142208 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-21e2e2ac-3fde-4fe8-9582-3892f7110146 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:14.142659 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-21e2e2ac-3fde-4fe8-9582-3892f7110146 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:14.143443 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-21e2e2ac-3fde-4fe8-9582-3892f7110146 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:14.143880 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-21e2e2ac-3fde-4fe8-9582-3892f7110146 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:14.406108 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-21e2e2ac-3fde-4fe8-9582-3892f7110146 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:14.415537 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-21e2e2ac-3fde-4fe8-9582-3892f7110146 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1521 microversion: 2.1 time: 0.286730 Apr 30 13:18:14.416104 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 81/186] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:14 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:18:14.649871 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-04189a0d-2389-421e-a940-b668abc3a71d tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:14.650631 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-04189a0d-2389-421e-a940-b668abc3a71d tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 725460b8-1eec-40a7-948f-6a7c80ebfd3b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:14.658030 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-04189a0d-2389-421e-a940-b668abc3a71d tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:14.658497 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-04189a0d-2389-421e-a940-b668abc3a71d tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:14.659288 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-04189a0d-2389-421e-a940-b668abc3a71d tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:14.659723 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-04189a0d-2389-421e-a940-b668abc3a71d tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:14.781102 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-04189a0d-2389-421e-a940-b668abc3a71d tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:14.790884 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-04189a0d-2389-421e-a940-b668abc3a71d tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/725460b8-1eec-40a7-948f-6a7c80ebfd3b" status: 200 len: 1269 microversion: 2.1 time: 0.145431 Apr 30 13:18:14.791478 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 82/187] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:14 2021] GET /compute/v2.1/servers/725460b8-1eec-40a7-948f-6a7c80ebfd3b => generated 1269 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:18:15.141529 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-179c7f86-2485-49f2-8470-5f05f1273268 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action" status: 200 len: 26696 microversion: 2.20 time: 2.738330 Apr 30 13:18:15.145430 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 106/188] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:18:12 2021] POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action => generated 26696 bytes in 2740 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 30 13:18:15.434244 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-aa6a4344-0b7c-47d4-829c-e11a2f3145ff tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:15.434874 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-aa6a4344-0b7c-47d4-829c-e11a2f3145ff tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:15.443342 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-aa6a4344-0b7c-47d4-829c-e11a2f3145ff tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:15.443801 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-aa6a4344-0b7c-47d4-829c-e11a2f3145ff tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:15.444598 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-aa6a4344-0b7c-47d4-829c-e11a2f3145ff tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:15.445643 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-aa6a4344-0b7c-47d4-829c-e11a2f3145ff tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:15.809637 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-dabc8723-abd2-4be6-9d0c-adca7a9fbb69 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:15.810537 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-dabc8723-abd2-4be6-9d0c-adca7a9fbb69 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 725460b8-1eec-40a7-948f-6a7c80ebfd3b] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:15.819419 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-dabc8723-abd2-4be6-9d0c-adca7a9fbb69 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:15.820453 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-dabc8723-abd2-4be6-9d0c-adca7a9fbb69 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:15.821764 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-dabc8723-abd2-4be6-9d0c-adca7a9fbb69 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:15.822471 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-dabc8723-abd2-4be6-9d0c-adca7a9fbb69 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:15.877825 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-aa6a4344-0b7c-47d4-829c-e11a2f3145ff tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:15.886753 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-aa6a4344-0b7c-47d4-829c-e11a2f3145ff tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1521 microversion: 2.1 time: 0.457785 Apr 30 13:18:15.887350 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 83/189] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:15 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1521 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:15.997177 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-dabc8723-abd2-4be6-9d0c-adca7a9fbb69 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:16.012617 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-dabc8723-abd2-4be6-9d0c-adca7a9fbb69 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/725460b8-1eec-40a7-948f-6a7c80ebfd3b" status: 200 len: 1275 microversion: 2.1 time: 0.207271 Apr 30 13:18:16.027834 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 107/190] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:15 2021] GET /compute/v2.1/servers/725460b8-1eec-40a7-948f-6a7c80ebfd3b => generated 1275 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:16.154451 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-4ad27155-96fb-4f02-b8c7-192b4b988dd8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:18:16.155393 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-4ad27155-96fb-4f02-b8c7-192b4b988dd8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:16.163856 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4ad27155-96fb-4f02-b8c7-192b4b988dd8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:16.164601 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4ad27155-96fb-4f02-b8c7-192b4b988dd8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:16.165766 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4ad27155-96fb-4f02-b8c7-192b4b988dd8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:16.166643 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4ad27155-96fb-4f02-b8c7-192b4b988dd8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:16.402087 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-4ad27155-96fb-4f02-b8c7-192b4b988dd8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action" status: 200 len: 27176 microversion: 2.20 time: 0.251215 Apr 30 13:18:16.402996 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 84/191] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:18:16 2021] POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action => generated 27176 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 30 13:18:16.864054 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-ba7f3463-701d-43a7-a2f2-5554223d4768 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1193889720", "imageRef": "705a0c6b-b003-4687-84bf-8b9f87dae39e", "flavorRef": "452"}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:18:16.914744 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-95504040-1718-4aa5-9788-d4800e1f6367 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:16.916086 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-95504040-1718-4aa5-9788-d4800e1f6367 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:16.932089 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-95504040-1718-4aa5-9788-d4800e1f6367 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:16.934735 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-95504040-1718-4aa5-9788-d4800e1f6367 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:16.934735 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-95504040-1718-4aa5-9788-d4800e1f6367 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:16.934735 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-95504040-1718-4aa5-9788-d4800e1f6367 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:16.972290 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.network.neutron [None req-ba7f3463-701d-43a7-a2f2-5554223d4768 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] validate_networks() for None {{(pid=87933) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 13:18:17.308194 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.virt.hardware [None req-ba7f3463-701d-43a7-a2f2-5554223d4768 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Flavor limits 0:0:0 {{(pid=87933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 13:18:17.308726 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.virt.hardware [None req-ba7f3463-701d-43a7-a2f2-5554223d4768 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Image limits 0:0:0 {{(pid=87933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 13:18:17.309547 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.virt.hardware [None req-ba7f3463-701d-43a7-a2f2-5554223d4768 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Flavor pref 0:0:0 {{(pid=87933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 13:18:17.310316 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.virt.hardware [None req-ba7f3463-701d-43a7-a2f2-5554223d4768 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Image pref 0:0:0 {{(pid=87933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 13:18:17.311021 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.virt.hardware [None req-ba7f3463-701d-43a7-a2f2-5554223d4768 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 13:18:17.331818 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ba7f3463-701d-43a7-a2f2-5554223d4768 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:17.332273 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ba7f3463-701d-43a7-a2f2-5554223d4768 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:17.333282 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ba7f3463-701d-43a7-a2f2-5554223d4768 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:17.334045 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ba7f3463-701d-43a7-a2f2-5554223d4768 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:17.341253 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-95504040-1718-4aa5-9788-d4800e1f6367 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:17.359357 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-95504040-1718-4aa5-9788-d4800e1f6367 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1521 microversion: 2.1 time: 0.449703 Apr 30 13:18:17.361213 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 85/192] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:16 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1521 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:18:17.372134 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-d2b6626d-1dc1-4f4b-a981-4c5d6da9cbd6 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:17.373554 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-d2b6626d-1dc1-4f4b-a981-4c5d6da9cbd6 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 725460b8-1eec-40a7-948f-6a7c80ebfd3b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:17.382028 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.quota [None req-ba7f3463-701d-43a7-a2f2-5554223d4768 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Getting quotas for project 723a1fc61e034b819f787a6c7412b855. Resources: {'ram', 'instances', 'cores'} {{(pid=87933) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:18:17.390520 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.quota [None req-ba7f3463-701d-43a7-a2f2-5554223d4768 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Getting quotas for user 69853458afe04251bc794811e860e0f7 and project 723a1fc61e034b819f787a6c7412b855. Resources: {'ram', 'instances', 'cores'} {{(pid=87933) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:18:17.394782 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d2b6626d-1dc1-4f4b-a981-4c5d6da9cbd6 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:17.395539 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d2b6626d-1dc1-4f4b-a981-4c5d6da9cbd6 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:17.396687 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d2b6626d-1dc1-4f4b-a981-4c5d6da9cbd6 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:17.398786 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d2b6626d-1dc1-4f4b-a981-4c5d6da9cbd6 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:17.404634 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-ba7f3463-701d-43a7-a2f2-5554223d4768 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Going to run 1 instances... {{(pid=87933) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 13:18:17.407389 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-ba7f3463-701d-43a7-a2f2-5554223d4768 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] [instance: f55df369-be4b-420f-918b-ae65b6d8fea8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='705a0c6b-b003-4687-84bf-8b9f87dae39e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=87933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 13:18:17.479672 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-ba7f3463-701d-43a7-a2f2-5554223d4768 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.619580 Apr 30 13:18:17.480523 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 108/193] 10.222.0.79 () {60 vars in 1147 bytes} [Fri Apr 30 13:18:16 2021] POST /compute/v2.1/servers => generated 380 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 13:18:17.485768 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-feccad61-3b75-4054-8135-ead8d6f0bd4d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:18:17.487291 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-feccad61-3b75-4054-8135-ead8d6f0bd4d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:17.523977 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-feccad61-3b75-4054-8135-ead8d6f0bd4d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:17.525244 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-feccad61-3b75-4054-8135-ead8d6f0bd4d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:17.526358 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-feccad61-3b75-4054-8135-ead8d6f0bd4d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:17.527013 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-feccad61-3b75-4054-8135-ead8d6f0bd4d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:17.731085 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-feccad61-3b75-4054-8135-ead8d6f0bd4d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action" status: 200 len: 27516 microversion: 2.20 time: 0.248840 Apr 30 13:18:17.732156 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 109/194] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:18:17 2021] POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action => generated 27516 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:18:17.742245 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-55df4961-6694-4e0a-b0d8-a2bcd288c0a6 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:17.746751 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-55df4961-6694-4e0a-b0d8-a2bcd288c0a6 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] [instance: f55df369-be4b-420f-918b-ae65b6d8fea8] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:17.917519 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-55df4961-6694-4e0a-b0d8-a2bcd288c0a6 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69853458afe04251bc794811e860e0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a1fc61e034b819f787a6c7412b855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:17.940317 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-55df4961-6694-4e0a-b0d8-a2bcd288c0a6 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] 10.222.0.79 "GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8" status: 200 len: 1215 microversion: 2.1 time: 0.206045 Apr 30 13:18:17.941354 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 110/195] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:17 2021] GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8 => generated 1215 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:18.058167 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-d2b6626d-1dc1-4f4b-a981-4c5d6da9cbd6 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:18.067002 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-d2b6626d-1dc1-4f4b-a981-4c5d6da9cbd6 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/725460b8-1eec-40a7-948f-6a7c80ebfd3b" status: 200 len: 1317 microversion: 2.1 time: 0.703981 Apr 30 13:18:18.067786 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 86/196] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:17 2021] GET /compute/v2.1/servers/725460b8-1eec-40a7-948f-6a7c80ebfd3b => generated 1317 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:18.164737 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [req-886b2100-885a-4f13-808b-764fbfe6ded5 req-560d75aa-59cd-45cd-b1c1-c0aa52db6e12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "725460b8-1eec-40a7-948f-6a7c80ebfd3b", "tag": "86cb4292-c6ff-4438-9d30-9f8d53f9b4bf"}]} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:18:18.166330 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:18:18.166330 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: warnings.warn(msg) Apr 30 13:18:18.205491 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-886b2100-885a-4f13-808b-764fbfe6ded5 req-560d75aa-59cd-45cd-b1c1-c0aa52db6e12 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:18.211066 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-886b2100-885a-4f13-808b-764fbfe6ded5 req-560d75aa-59cd-45cd-b1c1-c0aa52db6e12 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:18.255765 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.compute.server_external_events [req-886b2100-885a-4f13-808b-764fbfe6ded5 req-560d75aa-59cd-45cd-b1c1-c0aa52db6e12 service nova] Creating event network-changed:86cb4292-c6ff-4438-9d30-9f8d53f9b4bf for instance 725460b8-1eec-40a7-948f-6a7c80ebfd3b on hv-cinder-78836 Apr 30 13:18:18.262936 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [req-886b2100-885a-4f13-808b-764fbfe6ded5 req-560d75aa-59cd-45cd-b1c1-c0aa52db6e12 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102905 Apr 30 13:18:18.264959 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 111/197] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:18:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:18:18.378626 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-8b033fc1-8648-4716-be12-173e11ee1c61 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:18.379561 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-8b033fc1-8648-4716-be12-173e11ee1c61 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:18.393608 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8b033fc1-8648-4716-be12-173e11ee1c61 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:18.394418 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8b033fc1-8648-4716-be12-173e11ee1c61 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:18.395348 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8b033fc1-8648-4716-be12-173e11ee1c61 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:18.396086 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8b033fc1-8648-4716-be12-173e11ee1c61 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:18.690907 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-8b033fc1-8648-4716-be12-173e11ee1c61 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:18.700790 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-8b033fc1-8648-4716-be12-173e11ee1c61 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1521 microversion: 2.1 time: 0.325900 Apr 30 13:18:18.701835 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 87/198] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:18 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1521 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:18.749014 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-1160d4e1-fce7-4ce1-bcdd-349281d19760 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:18:18.750226 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-1160d4e1-fce7-4ce1-bcdd-349281d19760 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:18.759067 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1160d4e1-fce7-4ce1-bcdd-349281d19760 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:18.759736 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1160d4e1-fce7-4ce1-bcdd-349281d19760 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:18.760528 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1160d4e1-fce7-4ce1-bcdd-349281d19760 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:18.761037 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1160d4e1-fce7-4ce1-bcdd-349281d19760 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:18.958610 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-b35aa215-ee04-4198-807f-6f94883b74d4 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:18.959318 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-b35aa215-ee04-4198-807f-6f94883b74d4 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] [instance: f55df369-be4b-420f-918b-ae65b6d8fea8] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:18.967947 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b35aa215-ee04-4198-807f-6f94883b74d4 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:18.968573 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b35aa215-ee04-4198-807f-6f94883b74d4 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:18.971144 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b35aa215-ee04-4198-807f-6f94883b74d4 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:18.971144 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b35aa215-ee04-4198-807f-6f94883b74d4 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:19.093868 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-b35aa215-ee04-4198-807f-6f94883b74d4 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69853458afe04251bc794811e860e0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a1fc61e034b819f787a6c7412b855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:19.110590 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-b35aa215-ee04-4198-807f-6f94883b74d4 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] 10.222.0.79 "GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8" status: 200 len: 1211 microversion: 2.1 time: 0.155468 Apr 30 13:18:19.111513 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 88/199] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:18 2021] GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8 => generated 1211 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:18:19.120460 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-88384c65-d402-49cb-b325-1347dd11edee tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:19.121610 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-88384c65-d402-49cb-b325-1347dd11edee tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 725460b8-1eec-40a7-948f-6a7c80ebfd3b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:19.135187 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-88384c65-d402-49cb-b325-1347dd11edee tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:19.136014 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-88384c65-d402-49cb-b325-1347dd11edee tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:19.137487 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-88384c65-d402-49cb-b325-1347dd11edee tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:19.138114 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-88384c65-d402-49cb-b325-1347dd11edee tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:19.468129 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-88384c65-d402-49cb-b325-1347dd11edee tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:19.480605 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-88384c65-d402-49cb-b325-1347dd11edee tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/725460b8-1eec-40a7-948f-6a7c80ebfd3b" status: 200 len: 1317 microversion: 2.1 time: 0.367641 Apr 30 13:18:19.481190 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 89/200] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:19 2021] GET /compute/v2.1/servers/725460b8-1eec-40a7-948f-6a7c80ebfd3b => generated 1317 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:19.719306 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-06a2eca6-6031-47e5-93b1-3be7d4759a97 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:19.719948 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-06a2eca6-6031-47e5-93b1-3be7d4759a97 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:19.728340 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-06a2eca6-6031-47e5-93b1-3be7d4759a97 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:19.728825 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-06a2eca6-6031-47e5-93b1-3be7d4759a97 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:19.729676 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-06a2eca6-6031-47e5-93b1-3be7d4759a97 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:19.730159 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-06a2eca6-6031-47e5-93b1-3be7d4759a97 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:19.963994 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-06a2eca6-6031-47e5-93b1-3be7d4759a97 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:19.973139 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-06a2eca6-6031-47e5-93b1-3be7d4759a97 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1521 microversion: 2.1 time: 0.257727 Apr 30 13:18:19.973791 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 90/201] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:19 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:20.128801 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-44964f19-e1a6-4636-8dc0-1f8eae111b86 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:20.129517 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-44964f19-e1a6-4636-8dc0-1f8eae111b86 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] [instance: f55df369-be4b-420f-918b-ae65b6d8fea8] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:20.138298 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-44964f19-e1a6-4636-8dc0-1f8eae111b86 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:20.138760 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-44964f19-e1a6-4636-8dc0-1f8eae111b86 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:20.139619 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-44964f19-e1a6-4636-8dc0-1f8eae111b86 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:20.140010 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-44964f19-e1a6-4636-8dc0-1f8eae111b86 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:20.283026 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-44964f19-e1a6-4636-8dc0-1f8eae111b86 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69853458afe04251bc794811e860e0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a1fc61e034b819f787a6c7412b855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:20.297159 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-44964f19-e1a6-4636-8dc0-1f8eae111b86 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] 10.222.0.79 "GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8" status: 200 len: 1211 microversion: 2.1 time: 0.172086 Apr 30 13:18:20.297706 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 91/202] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:20 2021] GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8 => generated 1211 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:18:20.498160 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-da90110d-0e26-464f-abb2-e241b2319fea tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:20.498852 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-da90110d-0e26-464f-abb2-e241b2319fea tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 725460b8-1eec-40a7-948f-6a7c80ebfd3b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:20.506598 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-da90110d-0e26-464f-abb2-e241b2319fea tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:20.507111 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-da90110d-0e26-464f-abb2-e241b2319fea tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:20.507953 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-da90110d-0e26-464f-abb2-e241b2319fea tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:20.508393 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-da90110d-0e26-464f-abb2-e241b2319fea tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:20.746307 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-da90110d-0e26-464f-abb2-e241b2319fea tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:20.758887 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-da90110d-0e26-464f-abb2-e241b2319fea tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/725460b8-1eec-40a7-948f-6a7c80ebfd3b" status: 200 len: 1317 microversion: 2.1 time: 0.264211 Apr 30 13:18:20.770594 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 92/203] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:20 2021] GET /compute/v2.1/servers/725460b8-1eec-40a7-948f-6a7c80ebfd3b => generated 1317 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:18:20.990219 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-c6161704-f2ac-4641-9158-5873e148fd1c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:20.990219 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-c6161704-f2ac-4641-9158-5873e148fd1c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:20.997714 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c6161704-f2ac-4641-9158-5873e148fd1c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:20.998316 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c6161704-f2ac-4641-9158-5873e148fd1c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:20.999189 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c6161704-f2ac-4641-9158-5873e148fd1c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:20.999638 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c6161704-f2ac-4641-9158-5873e148fd1c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:21.202066 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-c6161704-f2ac-4641-9158-5873e148fd1c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:21.212999 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-c6161704-f2ac-4641-9158-5873e148fd1c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1521 microversion: 2.1 time: 0.227789 Apr 30 13:18:21.213633 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 93/204] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:20 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:18:21.317622 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-0cc5fedd-616f-4a4a-8a34-59e6ac52307d tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:21.318260 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-0cc5fedd-616f-4a4a-8a34-59e6ac52307d tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] [instance: f55df369-be4b-420f-918b-ae65b6d8fea8] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:21.325630 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0cc5fedd-616f-4a4a-8a34-59e6ac52307d tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:21.326108 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0cc5fedd-616f-4a4a-8a34-59e6ac52307d tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:21.326899 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0cc5fedd-616f-4a4a-8a34-59e6ac52307d tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:21.327334 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0cc5fedd-616f-4a4a-8a34-59e6ac52307d tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:21.443394 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-0cc5fedd-616f-4a4a-8a34-59e6ac52307d tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69853458afe04251bc794811e860e0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a1fc61e034b819f787a6c7412b855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:21.452077 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-0cc5fedd-616f-4a4a-8a34-59e6ac52307d tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] 10.222.0.79 "GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8" status: 200 len: 1211 microversion: 2.1 time: 0.138050 Apr 30 13:18:21.452570 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 94/205] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:21 2021] GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8 => generated 1211 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:18:21.605572 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-1160d4e1-fce7-4ce1-bcdd-349281d19760 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action" status: 200 len: 27852 microversion: 2.20 time: 2.863549 Apr 30 13:18:21.609627 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 112/206] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:18:18 2021] POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action => generated 27852 bytes in 2866 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 30 13:18:21.777919 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-6a83a9c5-e49e-4c47-a9e0-00ce72c68c2a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:21.778560 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-6a83a9c5-e49e-4c47-a9e0-00ce72c68c2a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 725460b8-1eec-40a7-948f-6a7c80ebfd3b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:21.786695 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6a83a9c5-e49e-4c47-a9e0-00ce72c68c2a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:21.787149 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6a83a9c5-e49e-4c47-a9e0-00ce72c68c2a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:21.787932 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6a83a9c5-e49e-4c47-a9e0-00ce72c68c2a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:21.788950 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6a83a9c5-e49e-4c47-a9e0-00ce72c68c2a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:22.214267 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-6a83a9c5-e49e-4c47-a9e0-00ce72c68c2a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:22.224647 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-6a83a9c5-e49e-4c47-a9e0-00ce72c68c2a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/725460b8-1eec-40a7-948f-6a7c80ebfd3b" status: 200 len: 1317 microversion: 2.1 time: 0.451614 Apr 30 13:18:22.231869 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b39fd09c-34e0-470c-a73c-c2984a88a1d4 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:22.232590 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-b39fd09c-34e0-470c-a73c-c2984a88a1d4 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:22.238184 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 95/207] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:21 2021] GET /compute/v2.1/servers/725460b8-1eec-40a7-948f-6a7c80ebfd3b => generated 1317 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:22.242286 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b39fd09c-34e0-470c-a73c-c2984a88a1d4 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:22.242751 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b39fd09c-34e0-470c-a73c-c2984a88a1d4 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:22.243565 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b39fd09c-34e0-470c-a73c-c2984a88a1d4 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:22.244013 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b39fd09c-34e0-470c-a73c-c2984a88a1d4 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:22.466357 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-b39fd09c-34e0-470c-a73c-c2984a88a1d4 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:22.471785 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-56f09b9f-1f9f-457c-a514-c7f1b9dc68c4 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:22.472978 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-56f09b9f-1f9f-457c-a514-c7f1b9dc68c4 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] [instance: f55df369-be4b-420f-918b-ae65b6d8fea8] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:22.480137 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b39fd09c-34e0-470c-a73c-c2984a88a1d4 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1521 microversion: 2.1 time: 0.252290 Apr 30 13:18:22.480753 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 113/208] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:22 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:22.483020 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-56f09b9f-1f9f-457c-a514-c7f1b9dc68c4 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:22.483622 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-56f09b9f-1f9f-457c-a514-c7f1b9dc68c4 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:22.485352 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-56f09b9f-1f9f-457c-a514-c7f1b9dc68c4 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:22.485845 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-56f09b9f-1f9f-457c-a514-c7f1b9dc68c4 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:22.618309 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-3a24fe6f-335c-41e3-b291-4cc21b07675c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:18:22.619654 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-3a24fe6f-335c-41e3-b291-4cc21b07675c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:22.629177 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3a24fe6f-335c-41e3-b291-4cc21b07675c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:22.629761 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3a24fe6f-335c-41e3-b291-4cc21b07675c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:22.630738 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3a24fe6f-335c-41e3-b291-4cc21b07675c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:22.631255 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3a24fe6f-335c-41e3-b291-4cc21b07675c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:22.672953 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-56f09b9f-1f9f-457c-a514-c7f1b9dc68c4 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69853458afe04251bc794811e860e0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a1fc61e034b819f787a6c7412b855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:22.688280 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-56f09b9f-1f9f-457c-a514-c7f1b9dc68c4 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] 10.222.0.79 "GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8" status: 200 len: 1285 microversion: 2.1 time: 0.221176 Apr 30 13:18:22.700074 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 96/209] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:22 2021] GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8 => generated 1285 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:18:22.814300 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-3a24fe6f-335c-41e3-b291-4cc21b07675c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action" status: 200 len: 28160 microversion: 2.20 time: 0.199701 Apr 30 13:18:22.818656 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 114/210] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:18:22 2021] POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action => generated 28160 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 30 13:18:23.255754 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-634eed5f-bcb2-4d99-845b-f520d9b4e536 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:23.256799 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-634eed5f-bcb2-4d99-845b-f520d9b4e536 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 725460b8-1eec-40a7-948f-6a7c80ebfd3b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:23.281062 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-634eed5f-bcb2-4d99-845b-f520d9b4e536 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:23.283165 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-634eed5f-bcb2-4d99-845b-f520d9b4e536 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:23.285593 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-634eed5f-bcb2-4d99-845b-f520d9b4e536 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:23.287603 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-634eed5f-bcb2-4d99-845b-f520d9b4e536 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:23.505614 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-185a2115-22fe-4d2e-a378-feb31b9a5ece tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:23.506375 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-185a2115-22fe-4d2e-a378-feb31b9a5ece tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:23.516461 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-185a2115-22fe-4d2e-a378-feb31b9a5ece tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:23.517496 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-185a2115-22fe-4d2e-a378-feb31b9a5ece tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:23.518567 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-185a2115-22fe-4d2e-a378-feb31b9a5ece tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:23.519201 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-185a2115-22fe-4d2e-a378-feb31b9a5ece tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:23.832905 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-185a2115-22fe-4d2e-a378-feb31b9a5ece tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:23.844796 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-185a2115-22fe-4d2e-a378-feb31b9a5ece tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1521 microversion: 2.1 time: 0.343460 Apr 30 13:18:23.846402 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 115/211] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:23 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1521 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:23.862331 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-25046c29-6334-4dd9-8169-70c1f14190d6 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:23.863053 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-25046c29-6334-4dd9-8169-70c1f14190d6 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] [instance: f55df369-be4b-420f-918b-ae65b6d8fea8] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:23.872878 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-25046c29-6334-4dd9-8169-70c1f14190d6 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:23.873649 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-25046c29-6334-4dd9-8169-70c1f14190d6 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:23.875435 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-25046c29-6334-4dd9-8169-70c1f14190d6 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:23.876307 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-25046c29-6334-4dd9-8169-70c1f14190d6 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:24.095291 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-25046c29-6334-4dd9-8169-70c1f14190d6 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69853458afe04251bc794811e860e0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a1fc61e034b819f787a6c7412b855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:24.120568 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-25046c29-6334-4dd9-8169-70c1f14190d6 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] 10.222.0.79 "GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8" status: 200 len: 1273 microversion: 2.1 time: 0.271895 Apr 30 13:18:24.122072 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 116/212] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:23 2021] GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8 => generated 1273 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:24.141799 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-57b07375-fcfd-485a-b0a4-1f1810b3ce3a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:18:24.143949 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-57b07375-fcfd-485a-b0a4-1f1810b3ce3a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:24.158396 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-57b07375-fcfd-485a-b0a4-1f1810b3ce3a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:24.159438 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-57b07375-fcfd-485a-b0a4-1f1810b3ce3a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:24.161111 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-57b07375-fcfd-485a-b0a4-1f1810b3ce3a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:24.162500 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-57b07375-fcfd-485a-b0a4-1f1810b3ce3a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:24.291456 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-634eed5f-bcb2-4d99-845b-f520d9b4e536 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:24.308469 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-634eed5f-bcb2-4d99-845b-f520d9b4e536 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/725460b8-1eec-40a7-948f-6a7c80ebfd3b" status: 200 len: 1317 microversion: 2.1 time: 1.056657 Apr 30 13:18:24.309249 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 97/213] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:23 2021] GET /compute/v2.1/servers/725460b8-1eec-40a7-948f-6a7c80ebfd3b => generated 1317 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:24.425225 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-57b07375-fcfd-485a-b0a4-1f1810b3ce3a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action" status: 200 len: 28160 microversion: 2.20 time: 0.300792 Apr 30 13:18:24.426480 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 117/214] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:18:24 2021] POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action => generated 28160 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:18:24.864469 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-c7a7095b-dcc2-4db6-83e9-321b760536f0 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:24.865177 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-c7a7095b-dcc2-4db6-83e9-321b760536f0 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:24.884596 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c7a7095b-dcc2-4db6-83e9-321b760536f0 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:24.886241 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c7a7095b-dcc2-4db6-83e9-321b760536f0 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:24.888136 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c7a7095b-dcc2-4db6-83e9-321b760536f0 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:24.888810 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c7a7095b-dcc2-4db6-83e9-321b760536f0 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:25.139824 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-495f1b11-1762-43f1-8bf8-be7004f7784f tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:25.140717 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-495f1b11-1762-43f1-8bf8-be7004f7784f tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] [instance: f55df369-be4b-420f-918b-ae65b6d8fea8] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:25.158396 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-495f1b11-1762-43f1-8bf8-be7004f7784f tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:25.158855 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-495f1b11-1762-43f1-8bf8-be7004f7784f tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:25.159683 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-495f1b11-1762-43f1-8bf8-be7004f7784f tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:25.160125 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-495f1b11-1762-43f1-8bf8-be7004f7784f tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:25.505824 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-c7a7095b-dcc2-4db6-83e9-321b760536f0 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:25.521343 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-c7a7095b-dcc2-4db6-83e9-321b760536f0 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1521 microversion: 2.1 time: 0.661078 Apr 30 13:18:25.537534 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 98/215] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:24 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1521 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:18:25.547956 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-22b99597-5eb6-4682-88f9-e72a5828e6f3 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:25.548817 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-22b99597-5eb6-4682-88f9-e72a5828e6f3 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 725460b8-1eec-40a7-948f-6a7c80ebfd3b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:25.566549 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-22b99597-5eb6-4682-88f9-e72a5828e6f3 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:25.572836 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-22b99597-5eb6-4682-88f9-e72a5828e6f3 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:25.574240 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-22b99597-5eb6-4682-88f9-e72a5828e6f3 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:25.575018 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-22b99597-5eb6-4682-88f9-e72a5828e6f3 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:25.949749 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-495f1b11-1762-43f1-8bf8-be7004f7784f tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69853458afe04251bc794811e860e0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a1fc61e034b819f787a6c7412b855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:25.975204 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-495f1b11-1762-43f1-8bf8-be7004f7784f tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] 10.222.0.79 "GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8" status: 200 len: 1315 microversion: 2.1 time: 0.839588 Apr 30 13:18:25.979301 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 118/216] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:25 2021] GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8 => generated 1315 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:25.996698 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-e60a2536-7223-461a-9538-bdc062ed4d0f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:18:25.997663 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-e60a2536-7223-461a-9538-bdc062ed4d0f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:26.015491 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e60a2536-7223-461a-9538-bdc062ed4d0f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:26.015949 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e60a2536-7223-461a-9538-bdc062ed4d0f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:26.016764 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e60a2536-7223-461a-9538-bdc062ed4d0f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:26.017206 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e60a2536-7223-461a-9538-bdc062ed4d0f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:26.242935 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-e60a2536-7223-461a-9538-bdc062ed4d0f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action" status: 200 len: 28451 microversion: 2.20 time: 0.261873 Apr 30 13:18:26.243836 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 119/217] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:18:25 2021] POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action => generated 28451 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:18:26.341233 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-22b99597-5eb6-4682-88f9-e72a5828e6f3 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:26.354699 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-22b99597-5eb6-4682-88f9-e72a5828e6f3 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/725460b8-1eec-40a7-948f-6a7c80ebfd3b" status: 200 len: 1317 microversion: 2.1 time: 0.814189 Apr 30 13:18:26.354699 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 99/218] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:25 2021] GET /compute/v2.1/servers/725460b8-1eec-40a7-948f-6a7c80ebfd3b => generated 1317 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:26.552575 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-4c622146-6d35-4021-9fb2-438d6b6b8ef4 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:26.553982 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-4c622146-6d35-4021-9fb2-438d6b6b8ef4 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:26.576821 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4c622146-6d35-4021-9fb2-438d6b6b8ef4 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:26.577626 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4c622146-6d35-4021-9fb2-438d6b6b8ef4 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:26.580050 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4c622146-6d35-4021-9fb2-438d6b6b8ef4 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:26.580695 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4c622146-6d35-4021-9fb2-438d6b6b8ef4 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:26.836511 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-4c622146-6d35-4021-9fb2-438d6b6b8ef4 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:26.849468 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-4c622146-6d35-4021-9fb2-438d6b6b8ef4 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1521 microversion: 2.1 time: 0.306446 Apr 30 13:18:26.850361 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 120/219] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:26 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1521 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:27.010105 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-4b6462d0-4289-4fb4-84b2-40dc4e2c7f57 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:27.012219 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-4b6462d0-4289-4fb4-84b2-40dc4e2c7f57 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] [instance: f55df369-be4b-420f-918b-ae65b6d8fea8] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:27.023608 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4b6462d0-4289-4fb4-84b2-40dc4e2c7f57 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:27.024131 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4b6462d0-4289-4fb4-84b2-40dc4e2c7f57 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:27.025028 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4b6462d0-4289-4fb4-84b2-40dc4e2c7f57 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:27.025580 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4b6462d0-4289-4fb4-84b2-40dc4e2c7f57 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:27.258899 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-2eafa0c5-685d-47c2-943e-6f895e1cf57e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:18:27.261224 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-2eafa0c5-685d-47c2-943e-6f895e1cf57e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:27.270533 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2eafa0c5-685d-47c2-943e-6f895e1cf57e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:27.271112 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2eafa0c5-685d-47c2-943e-6f895e1cf57e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:27.272109 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2eafa0c5-685d-47c2-943e-6f895e1cf57e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:27.273304 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2eafa0c5-685d-47c2-943e-6f895e1cf57e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:27.516574 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-2eafa0c5-685d-47c2-943e-6f895e1cf57e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action" status: 200 len: 28451 microversion: 2.20 time: 0.263013 Apr 30 13:18:27.517499 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 121/220] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:18:27 2021] POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action => generated 28451 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 30 13:18:27.523925 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [req-611f3fa1-e254-476d-bc21-40045fc02a02 req-5ffd91e5-44f5-40e9-a171-543dce6e96c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f55df369-be4b-420f-918b-ae65b6d8fea8", "tag": "666547ca-74f8-4ce0-8769-6f5f3b80978e"}]} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:18:27.526279 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:18:27.526279 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: warnings.warn(msg) Apr 30 13:18:27.548585 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-611f3fa1-e254-476d-bc21-40045fc02a02 req-5ffd91e5-44f5-40e9-a171-543dce6e96c0 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:27.554967 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-611f3fa1-e254-476d-bc21-40045fc02a02 req-5ffd91e5-44f5-40e9-a171-543dce6e96c0 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:27.589684 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.compute.server_external_events [req-611f3fa1-e254-476d-bc21-40045fc02a02 req-5ffd91e5-44f5-40e9-a171-543dce6e96c0 service nova] Creating event network-changed:666547ca-74f8-4ce0-8769-6f5f3b80978e for instance f55df369-be4b-420f-918b-ae65b6d8fea8 on hv-cinder-78836 Apr 30 13:18:27.595426 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [req-611f3fa1-e254-476d-bc21-40045fc02a02 req-5ffd91e5-44f5-40e9-a171-543dce6e96c0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075933 Apr 30 13:18:27.597018 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 122/221] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:18:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:18:27.609323 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-685d1786-56a5-44f8-bb16-7966c6d256c3 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:27.611937 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-685d1786-56a5-44f8-bb16-7966c6d256c3 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 725460b8-1eec-40a7-948f-6a7c80ebfd3b] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:27.648904 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-685d1786-56a5-44f8-bb16-7966c6d256c3 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:27.650962 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-4b6462d0-4289-4fb4-84b2-40dc4e2c7f57 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69853458afe04251bc794811e860e0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a1fc61e034b819f787a6c7412b855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:27.651829 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-685d1786-56a5-44f8-bb16-7966c6d256c3 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:27.652794 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-685d1786-56a5-44f8-bb16-7966c6d256c3 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:27.653780 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-685d1786-56a5-44f8-bb16-7966c6d256c3 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:27.669246 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-4b6462d0-4289-4fb4-84b2-40dc4e2c7f57 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] 10.222.0.79 "GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8" status: 200 len: 1315 microversion: 2.1 time: 0.664989 Apr 30 13:18:27.669886 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 100/222] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:26 2021] GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8 => generated 1315 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:27.869782 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-47f8bdce-9081-40b1-8038-b5f2abb22e96 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:27.870741 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-47f8bdce-9081-40b1-8038-b5f2abb22e96 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:27.885209 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-47f8bdce-9081-40b1-8038-b5f2abb22e96 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:27.885883 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-47f8bdce-9081-40b1-8038-b5f2abb22e96 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:27.886924 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-47f8bdce-9081-40b1-8038-b5f2abb22e96 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:27.899037 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-47f8bdce-9081-40b1-8038-b5f2abb22e96 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:28.315785 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-685d1786-56a5-44f8-bb16-7966c6d256c3 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:28.328239 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-685d1786-56a5-44f8-bb16-7966c6d256c3 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/725460b8-1eec-40a7-948f-6a7c80ebfd3b" status: 200 len: 1317 microversion: 2.1 time: 0.729330 Apr 30 13:18:28.329099 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 123/223] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:27 2021] GET /compute/v2.1/servers/725460b8-1eec-40a7-948f-6a7c80ebfd3b => generated 1317 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:28.481667 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-47f8bdce-9081-40b1-8038-b5f2abb22e96 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:28.491029 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-47f8bdce-9081-40b1-8038-b5f2abb22e96 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1521 microversion: 2.1 time: 0.626266 Apr 30 13:18:28.492109 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 101/224] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:27 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1521 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:18:28.529234 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-755ef76a-bef3-48a2-9d3b-592da3a6017e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:18:28.530418 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-755ef76a-bef3-48a2-9d3b-592da3a6017e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:28.539043 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-755ef76a-bef3-48a2-9d3b-592da3a6017e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:28.539800 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-755ef76a-bef3-48a2-9d3b-592da3a6017e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:28.540671 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-755ef76a-bef3-48a2-9d3b-592da3a6017e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:28.541260 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-755ef76a-bef3-48a2-9d3b-592da3a6017e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:28.687308 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-fb65b721-d95f-4462-b863-29f2e8289ef1 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:28.688246 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-fb65b721-d95f-4462-b863-29f2e8289ef1 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] [instance: f55df369-be4b-420f-918b-ae65b6d8fea8] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:28.696622 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fb65b721-d95f-4462-b863-29f2e8289ef1 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:28.697080 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fb65b721-d95f-4462-b863-29f2e8289ef1 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:28.698058 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fb65b721-d95f-4462-b863-29f2e8289ef1 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:28.698693 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fb65b721-d95f-4462-b863-29f2e8289ef1 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:28.726183 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-755ef76a-bef3-48a2-9d3b-592da3a6017e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action" status: 200 len: 28619 microversion: 2.20 time: 0.200286 Apr 30 13:18:28.731153 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 124/225] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:18:28 2021] POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action => generated 28619 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:18:28.988383 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-fb65b721-d95f-4462-b863-29f2e8289ef1 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69853458afe04251bc794811e860e0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a1fc61e034b819f787a6c7412b855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:28.998277 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-fb65b721-d95f-4462-b863-29f2e8289ef1 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] 10.222.0.79 "GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8" status: 200 len: 1315 microversion: 2.1 time: 0.314628 Apr 30 13:18:29.009095 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 102/226] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:28 2021] GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8 => generated 1315 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:29.348541 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-2ae95299-1c22-423a-bb4b-7302d632cade tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:29.350122 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-2ae95299-1c22-423a-bb4b-7302d632cade tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 725460b8-1eec-40a7-948f-6a7c80ebfd3b] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:29.360185 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2ae95299-1c22-423a-bb4b-7302d632cade tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:29.361021 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2ae95299-1c22-423a-bb4b-7302d632cade tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:29.362772 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2ae95299-1c22-423a-bb4b-7302d632cade tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:29.363445 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2ae95299-1c22-423a-bb4b-7302d632cade tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:29.509123 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-2c689868-4019-4860-a8ab-bfaa691b77a6 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:29.509751 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-2c689868-4019-4860-a8ab-bfaa691b77a6 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:29.526142 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2c689868-4019-4860-a8ab-bfaa691b77a6 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:29.526607 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2c689868-4019-4860-a8ab-bfaa691b77a6 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:29.527416 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2c689868-4019-4860-a8ab-bfaa691b77a6 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:29.528057 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2c689868-4019-4860-a8ab-bfaa691b77a6 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:29.871308 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-2ae95299-1c22-423a-bb4b-7302d632cade tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:29.915062 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-2ae95299-1c22-423a-bb4b-7302d632cade tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/725460b8-1eec-40a7-948f-6a7c80ebfd3b" status: 200 len: 1317 microversion: 2.1 time: 0.568134 Apr 30 13:18:29.916370 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 125/227] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:29 2021] GET /compute/v2.1/servers/725460b8-1eec-40a7-948f-6a7c80ebfd3b => generated 1317 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:29.931243 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-9dc0e60c-80c4-426e-96b6-d24cfb8ee91b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:18:29.932351 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-9dc0e60c-80c4-426e-96b6-d24cfb8ee91b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:29.943639 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9dc0e60c-80c4-426e-96b6-d24cfb8ee91b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:29.944984 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9dc0e60c-80c4-426e-96b6-d24cfb8ee91b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:29.946311 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9dc0e60c-80c4-426e-96b6-d24cfb8ee91b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:29.947469 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9dc0e60c-80c4-426e-96b6-d24cfb8ee91b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:30.122442 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-9dc0e60c-80c4-426e-96b6-d24cfb8ee91b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action" status: 200 len: 28619 microversion: 2.20 time: 0.203635 Apr 30 13:18:30.124546 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 126/228] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:18:29 2021] POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action => generated 28619 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:18:30.130879 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [req-1041da33-7548-4b70-a2ae-1769240dcd15 req-703051e5-d13a-4d83-846c-2bb794cdd25c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "725460b8-1eec-40a7-948f-6a7c80ebfd3b", "name": "network-vif-plugged", "status": "completed", "tag": "86cb4292-c6ff-4438-9d30-9f8d53f9b4bf"}]} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:18:30.136341 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:18:30.136341 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: warnings.warn(msg) Apr 30 13:18:30.148325 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-1041da33-7548-4b70-a2ae-1769240dcd15 req-703051e5-d13a-4d83-846c-2bb794cdd25c service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:30.148774 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-1041da33-7548-4b70-a2ae-1769240dcd15 req-703051e5-d13a-4d83-846c-2bb794cdd25c service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:30.168804 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.compute.server_external_events [req-1041da33-7548-4b70-a2ae-1769240dcd15 req-703051e5-d13a-4d83-846c-2bb794cdd25c service nova] Creating event network-vif-plugged:86cb4292-c6ff-4438-9d30-9f8d53f9b4bf for instance 725460b8-1eec-40a7-948f-6a7c80ebfd3b on hv-cinder-78836 Apr 30 13:18:30.178335 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [req-1041da33-7548-4b70-a2ae-1769240dcd15 req-703051e5-d13a-4d83-846c-2bb794cdd25c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052084 Apr 30 13:18:30.181917 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 127/229] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:18:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:18:30.188403 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-3a98bb9a-dbab-4383-9df5-810a55b001fc tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:30.189780 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-3a98bb9a-dbab-4383-9df5-810a55b001fc tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] [instance: f55df369-be4b-420f-918b-ae65b6d8fea8] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:30.198078 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3a98bb9a-dbab-4383-9df5-810a55b001fc tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:30.198778 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3a98bb9a-dbab-4383-9df5-810a55b001fc tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:30.199895 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3a98bb9a-dbab-4383-9df5-810a55b001fc tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:30.200225 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3a98bb9a-dbab-4383-9df5-810a55b001fc tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:30.369507 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-2c689868-4019-4860-a8ab-bfaa691b77a6 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:30.384995 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-2c689868-4019-4860-a8ab-bfaa691b77a6 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1521 microversion: 2.1 time: 0.879263 Apr 30 13:18:30.385950 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 103/230] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:29 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1521 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:30.539977 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-3a98bb9a-dbab-4383-9df5-810a55b001fc tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69853458afe04251bc794811e860e0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a1fc61e034b819f787a6c7412b855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:30.550229 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-3a98bb9a-dbab-4383-9df5-810a55b001fc tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] 10.222.0.79 "GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8" status: 200 len: 1315 microversion: 2.1 time: 0.366701 Apr 30 13:18:30.551684 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 128/231] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:30 2021] GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8 => generated 1315 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:30.933857 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-07de5931-d877-49d5-8f15-8a2a5b5b6605 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:30.934337 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-07de5931-d877-49d5-8f15-8a2a5b5b6605 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 725460b8-1eec-40a7-948f-6a7c80ebfd3b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:30.948374 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-07de5931-d877-49d5-8f15-8a2a5b5b6605 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:30.948684 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-07de5931-d877-49d5-8f15-8a2a5b5b6605 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:30.949489 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-07de5931-d877-49d5-8f15-8a2a5b5b6605 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:30.949924 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-07de5931-d877-49d5-8f15-8a2a5b5b6605 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:31.136625 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-2d450804-5023-4083-b8fb-5aeff18d9202 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:18:31.137603 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-2d450804-5023-4083-b8fb-5aeff18d9202 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:31.150979 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2d450804-5023-4083-b8fb-5aeff18d9202 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:31.151789 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2d450804-5023-4083-b8fb-5aeff18d9202 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:31.153213 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2d450804-5023-4083-b8fb-5aeff18d9202 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:31.154044 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2d450804-5023-4083-b8fb-5aeff18d9202 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:31.395765 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-07de5931-d877-49d5-8f15-8a2a5b5b6605 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:31.406536 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-07de5931-d877-49d5-8f15-8a2a5b5b6605 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/725460b8-1eec-40a7-948f-6a7c80ebfd3b" status: 200 len: 1317 microversion: 2.1 time: 0.476619 Apr 30 13:18:31.407694 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 104/232] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:30 2021] GET /compute/v2.1/servers/725460b8-1eec-40a7-948f-6a7c80ebfd3b => generated 1317 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:18:31.415669 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-8370e1c3-0862-4bf0-a9c8-28999149250d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:31.416592 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-8370e1c3-0862-4bf0-a9c8-28999149250d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:31.430162 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8370e1c3-0862-4bf0-a9c8-28999149250d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:31.431059 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8370e1c3-0862-4bf0-a9c8-28999149250d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:31.432472 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8370e1c3-0862-4bf0-a9c8-28999149250d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:31.433384 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8370e1c3-0862-4bf0-a9c8-28999149250d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:31.443892 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-2d450804-5023-4083-b8fb-5aeff18d9202 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action" status: 200 len: 28619 microversion: 2.20 time: 0.312520 Apr 30 13:18:31.446294 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 129/233] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:18:31 2021] POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action => generated 28619 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:18:31.575708 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-a661df59-2427-4a29-aa75-536c35f87840 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:31.576382 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-a661df59-2427-4a29-aa75-536c35f87840 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] [instance: f55df369-be4b-420f-918b-ae65b6d8fea8] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:31.591188 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a661df59-2427-4a29-aa75-536c35f87840 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:31.591963 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a661df59-2427-4a29-aa75-536c35f87840 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:31.593250 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a661df59-2427-4a29-aa75-536c35f87840 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:31.593836 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a661df59-2427-4a29-aa75-536c35f87840 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:31.740447 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-8370e1c3-0862-4bf0-a9c8-28999149250d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:31.756176 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-8370e1c3-0862-4bf0-a9c8-28999149250d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1521 microversion: 2.1 time: 0.346058 Apr 30 13:18:31.767436 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 105/234] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:31 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1521 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:32.187375 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-a661df59-2427-4a29-aa75-536c35f87840 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69853458afe04251bc794811e860e0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a1fc61e034b819f787a6c7412b855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:32.197594 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-a661df59-2427-4a29-aa75-536c35f87840 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] 10.222.0.79 "GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8" status: 200 len: 1315 microversion: 2.1 time: 0.626079 Apr 30 13:18:32.208467 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 130/235] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:31 2021] GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8 => generated 1315 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:32.424474 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-2330b3ec-bb19-41a3-9b2a-ccdc3292438a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:32.425390 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-2330b3ec-bb19-41a3-9b2a-ccdc3292438a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 725460b8-1eec-40a7-948f-6a7c80ebfd3b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:32.439953 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2330b3ec-bb19-41a3-9b2a-ccdc3292438a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:32.440436 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2330b3ec-bb19-41a3-9b2a-ccdc3292438a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:32.441249 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2330b3ec-bb19-41a3-9b2a-ccdc3292438a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:32.441725 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2330b3ec-bb19-41a3-9b2a-ccdc3292438a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:32.457885 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-2397338a-fe8d-405d-8fdb-5ec5f6ca1ced tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:18:32.458855 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-2397338a-fe8d-405d-8fdb-5ec5f6ca1ced tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:32.477539 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2397338a-fe8d-405d-8fdb-5ec5f6ca1ced tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:32.483139 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2397338a-fe8d-405d-8fdb-5ec5f6ca1ced tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:32.484424 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2397338a-fe8d-405d-8fdb-5ec5f6ca1ced tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:32.484860 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2397338a-fe8d-405d-8fdb-5ec5f6ca1ced tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:32.822740 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-2397338a-fe8d-405d-8fdb-5ec5f6ca1ced tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action" status: 200 len: 28619 microversion: 2.20 time: 0.367803 Apr 30 13:18:32.835002 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 131/236] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:18:32 2021] POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action => generated 28619 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:18:32.866543 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-9d372e69-5b42-48db-8275-98972c74dc0e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:32.869927 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-9d372e69-5b42-48db-8275-98972c74dc0e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:32.883201 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9d372e69-5b42-48db-8275-98972c74dc0e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:32.884203 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9d372e69-5b42-48db-8275-98972c74dc0e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:32.885715 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9d372e69-5b42-48db-8275-98972c74dc0e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:32.886616 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9d372e69-5b42-48db-8275-98972c74dc0e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:33.036981 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-2330b3ec-bb19-41a3-9b2a-ccdc3292438a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:33.061751 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-2330b3ec-bb19-41a3-9b2a-ccdc3292438a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/725460b8-1eec-40a7-948f-6a7c80ebfd3b" status: 200 len: 1317 microversion: 2.1 time: 0.640881 Apr 30 13:18:33.064626 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 106/237] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:32 2021] GET /compute/v2.1/servers/725460b8-1eec-40a7-948f-6a7c80ebfd3b => generated 1317 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:33.214572 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-8efc12d0-a717-4ec5-abda-cb02f8342e96 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:33.215396 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-8efc12d0-a717-4ec5-abda-cb02f8342e96 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] [instance: f55df369-be4b-420f-918b-ae65b6d8fea8] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:33.229374 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8efc12d0-a717-4ec5-abda-cb02f8342e96 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:33.235638 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8efc12d0-a717-4ec5-abda-cb02f8342e96 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:33.236782 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8efc12d0-a717-4ec5-abda-cb02f8342e96 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:33.237383 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8efc12d0-a717-4ec5-abda-cb02f8342e96 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:33.458640 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-9d372e69-5b42-48db-8275-98972c74dc0e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:33.467868 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-9d372e69-5b42-48db-8275-98972c74dc0e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1521 microversion: 2.1 time: 0.630486 Apr 30 13:18:33.477299 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 132/238] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:32 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1521 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:33.703882 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-8efc12d0-a717-4ec5-abda-cb02f8342e96 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69853458afe04251bc794811e860e0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a1fc61e034b819f787a6c7412b855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:33.718861 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-8efc12d0-a717-4ec5-abda-cb02f8342e96 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] 10.222.0.79 "GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8" status: 200 len: 1315 microversion: 2.1 time: 0.508062 Apr 30 13:18:33.719753 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 107/239] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:33 2021] GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8 => generated 1315 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:33.840965 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-907eae4a-70c3-444e-b62a-34505cd7150c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:18:33.842716 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-907eae4a-70c3-444e-b62a-34505cd7150c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:33.851506 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-907eae4a-70c3-444e-b62a-34505cd7150c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:33.852473 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-907eae4a-70c3-444e-b62a-34505cd7150c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:33.853574 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-907eae4a-70c3-444e-b62a-34505cd7150c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:33.854463 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-907eae4a-70c3-444e-b62a-34505cd7150c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:34.032003 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-907eae4a-70c3-444e-b62a-34505cd7150c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action" status: 200 len: 28619 microversion: 2.20 time: 0.195556 Apr 30 13:18:34.032877 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 133/240] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:18:33 2021] POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action => generated 28619 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 30 13:18:34.081641 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-8a6ec521-bf39-44c6-b4f3-8e9bdfb10bcf tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:34.082634 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-8a6ec521-bf39-44c6-b4f3-8e9bdfb10bcf tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 725460b8-1eec-40a7-948f-6a7c80ebfd3b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:34.092649 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8a6ec521-bf39-44c6-b4f3-8e9bdfb10bcf tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:34.093902 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8a6ec521-bf39-44c6-b4f3-8e9bdfb10bcf tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:34.095096 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8a6ec521-bf39-44c6-b4f3-8e9bdfb10bcf tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:34.096216 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8a6ec521-bf39-44c6-b4f3-8e9bdfb10bcf tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:34.469121 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-8a6ec521-bf39-44c6-b4f3-8e9bdfb10bcf tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:34.485928 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-8a6ec521-bf39-44c6-b4f3-8e9bdfb10bcf tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/725460b8-1eec-40a7-948f-6a7c80ebfd3b" status: 200 len: 1508 microversion: 2.1 time: 0.406046 Apr 30 13:18:34.486147 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-7f94aa5a-2a6d-454d-b579-014d617e442e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:34.486942 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-7f94aa5a-2a6d-454d-b579-014d617e442e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:34.487688 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 108/241] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:34 2021] GET /compute/v2.1/servers/725460b8-1eec-40a7-948f-6a7c80ebfd3b => generated 1508 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:34.505401 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-809d1f39-65be-4480-8812-daa7337b3870 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40047847-c66a-4761-9d03-52ad034a0282"}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:18:34.507568 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-809d1f39-65be-4480-8812-daa7337b3870 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 725460b8-1eec-40a7-948f-6a7c80ebfd3b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:34.514621 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7f94aa5a-2a6d-454d-b579-014d617e442e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:34.525346 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7f94aa5a-2a6d-454d-b579-014d617e442e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:34.526574 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7f94aa5a-2a6d-454d-b579-014d617e442e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:34.526853 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-809d1f39-65be-4480-8812-daa7337b3870 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:34.527364 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7f94aa5a-2a6d-454d-b579-014d617e442e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:34.527530 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-809d1f39-65be-4480-8812-daa7337b3870 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:34.528540 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-809d1f39-65be-4480-8812-daa7337b3870 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:34.530830 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-809d1f39-65be-4480-8812-daa7337b3870 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:35.013269 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-7f94aa5a-2a6d-454d-b579-014d617e442e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:35.018197 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.wsgi [None req-809d1f39-65be-4480-8812-daa7337b3870 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] HTTP exception thrown: Invalid volume: volume 40047847-c66a-4761-9d03-52ad034a0282 is already attached to instances: d94a56dc-cb9d-4b55-9f89-b121d45230ca Apr 30 13:18:35.019801 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-809d1f39-65be-4480-8812-daa7337b3870 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Returning 400 to user: Invalid volume: volume 40047847-c66a-4761-9d03-52ad034a0282 is already attached to instances: d94a56dc-cb9d-4b55-9f89-b121d45230ca {{(pid=87932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:18:35.023886 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-809d1f39-65be-4480-8812-daa7337b3870 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "POST /compute/v2.1/servers/725460b8-1eec-40a7-948f-6a7c80ebfd3b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.520836 Apr 30 13:18:35.026174 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 109/242] 10.222.0.79 () {60 vars in 1323 bytes} [Fri Apr 30 13:18:34 2021] POST /compute/v2.1/servers/725460b8-1eec-40a7-948f-6a7c80ebfd3b/os-volume_attachments => generated 174 bytes in 526 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 30 13:18:35.029268 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-7f94aa5a-2a6d-454d-b579-014d617e442e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1521 microversion: 2.1 time: 0.547489 Apr 30 13:18:35.042569 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-e5955356-2e97-4064-910f-9bc6b2435e25 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:35.042569 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-e5955356-2e97-4064-910f-9bc6b2435e25 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] [instance: f55df369-be4b-420f-918b-ae65b6d8fea8] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:35.043488 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 134/243] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:34 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1521 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:35.049364 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-9a8f9caa-f6d5-4b2d-bc8e-f68ab6331be7 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:18:35.050569 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-9a8f9caa-f6d5-4b2d-bc8e-f68ab6331be7 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:35.059136 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9a8f9caa-f6d5-4b2d-bc8e-f68ab6331be7 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:35.060072 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9a8f9caa-f6d5-4b2d-bc8e-f68ab6331be7 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:35.061660 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9a8f9caa-f6d5-4b2d-bc8e-f68ab6331be7 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:35.062784 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9a8f9caa-f6d5-4b2d-bc8e-f68ab6331be7 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:35.063390 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e5955356-2e97-4064-910f-9bc6b2435e25 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:35.063863 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e5955356-2e97-4064-910f-9bc6b2435e25 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:35.064676 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e5955356-2e97-4064-910f-9bc6b2435e25 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:35.065141 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e5955356-2e97-4064-910f-9bc6b2435e25 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:35.484801 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-9a8f9caa-f6d5-4b2d-bc8e-f68ab6331be7 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action" status: 200 len: 28619 microversion: 2.20 time: 0.439702 Apr 30 13:18:35.486907 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 135/244] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:18:35 2021] POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action => generated 28619 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:18:35.499086 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-e5955356-2e97-4064-910f-9bc6b2435e25 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69853458afe04251bc794811e860e0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a1fc61e034b819f787a6c7412b855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:35.510217 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-e5955356-2e97-4064-910f-9bc6b2435e25 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] 10.222.0.79 "GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8" status: 200 len: 1315 microversion: 2.1 time: 0.481429 Apr 30 13:18:35.512249 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 110/245] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:35 2021] GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8 => generated 1315 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:35.585177 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-9cebf791-fa1c-4287-b722-24e4f7c0cf85 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:35.585866 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-9cebf791-fa1c-4287-b722-24e4f7c0cf85 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: d94a56dc-cb9d-4b55-9f89-b121d45230ca] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:35.595423 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9cebf791-fa1c-4287-b722-24e4f7c0cf85 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:35.595955 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9cebf791-fa1c-4287-b722-24e4f7c0cf85 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:35.596839 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9cebf791-fa1c-4287-b722-24e4f7c0cf85 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:35.597348 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9cebf791-fa1c-4287-b722-24e4f7c0cf85 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:35.878470 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [req-89cd4c66-7264-42e2-8287-6d3d9e3bd091 req-30906723-c202-4cba-8231-bf9056f9bc0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f55df369-be4b-420f-918b-ae65b6d8fea8", "name": "network-vif-plugged", "status": "completed", "tag": "666547ca-74f8-4ce0-8769-6f5f3b80978e"}]} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:18:35.880054 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:18:35.880054 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: warnings.warn(msg) Apr 30 13:18:35.908547 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-89cd4c66-7264-42e2-8287-6d3d9e3bd091 req-30906723-c202-4cba-8231-bf9056f9bc0e service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:35.909945 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-89cd4c66-7264-42e2-8287-6d3d9e3bd091 req-30906723-c202-4cba-8231-bf9056f9bc0e service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:35.941387 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.compute.server_external_events [req-89cd4c66-7264-42e2-8287-6d3d9e3bd091 req-30906723-c202-4cba-8231-bf9056f9bc0e service nova] Creating event network-vif-plugged:666547ca-74f8-4ce0-8769-6f5f3b80978e for instance f55df369-be4b-420f-918b-ae65b6d8fea8 on hv-cinder-78836 Apr 30 13:18:35.953717 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [req-89cd4c66-7264-42e2-8287-6d3d9e3bd091 req-30906723-c202-4cba-8231-bf9056f9bc0e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080158 Apr 30 13:18:35.954571 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 111/246] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:18:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:18:35.999936 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.objects.instance [None req-9cebf791-fa1c-4287-b722-24e4f7c0cf85 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lazy-loading 'services' on Instance uuid d94a56dc-cb9d-4b55-9f89-b121d45230ca {{(pid=87933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:18:36.051097 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-abe81c1c-eceb-4266-b145-b9ce6ddaeadd tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:36.052406 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-abe81c1c-eceb-4266-b145-b9ce6ddaeadd tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:36.063126 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-abe81c1c-eceb-4266-b145-b9ce6ddaeadd tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:36.064105 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-abe81c1c-eceb-4266-b145-b9ce6ddaeadd tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:36.065179 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-abe81c1c-eceb-4266-b145-b9ce6ddaeadd tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:36.065864 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-abe81c1c-eceb-4266-b145-b9ce6ddaeadd tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:36.274157 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-9cebf791-fa1c-4287-b722-24e4f7c0cf85 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca/os-volume_attachments/40047847-c66a-4761-9d03-52ad034a0282" status: 202 len: 0 microversion: 2.1 time: 0.692394 Apr 30 13:18:36.280768 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 136/247] 10.222.0.79 () {58 vars in 1416 bytes} [Fri Apr 30 13:18:35 2021] DELETE /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca/os-volume_attachments/40047847-c66a-4761-9d03-52ad034a0282 => generated 0 bytes in 702 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:18:36.435328 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-abe81c1c-eceb-4266-b145-b9ce6ddaeadd tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:36.451723 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-abe81c1c-eceb-4266-b145-b9ce6ddaeadd tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1521 microversion: 2.1 time: 0.404721 Apr 30 13:18:36.463790 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 112/248] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:36 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1521 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:36.498794 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-2a544ee1-6972-48e0-be18-6ddcca97e90f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:18:36.499816 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-2a544ee1-6972-48e0-be18-6ddcca97e90f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:36.526173 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2a544ee1-6972-48e0-be18-6ddcca97e90f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:36.526634 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2a544ee1-6972-48e0-be18-6ddcca97e90f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:36.528044 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2a544ee1-6972-48e0-be18-6ddcca97e90f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:36.528490 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2a544ee1-6972-48e0-be18-6ddcca97e90f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:36.530515 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-4085fcf7-3309-46aa-8081-941e119a7324 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:36.531218 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-4085fcf7-3309-46aa-8081-941e119a7324 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] [instance: f55df369-be4b-420f-918b-ae65b6d8fea8] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:36.544135 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4085fcf7-3309-46aa-8081-941e119a7324 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:36.544609 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4085fcf7-3309-46aa-8081-941e119a7324 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:36.545550 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4085fcf7-3309-46aa-8081-941e119a7324 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:36.545988 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4085fcf7-3309-46aa-8081-941e119a7324 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:36.857900 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-4085fcf7-3309-46aa-8081-941e119a7324 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69853458afe04251bc794811e860e0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a1fc61e034b819f787a6c7412b855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:36.869168 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-4085fcf7-3309-46aa-8081-941e119a7324 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] 10.222.0.79 "GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8" status: 200 len: 1315 microversion: 2.1 time: 0.342640 Apr 30 13:18:36.870310 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 113/249] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:36 2021] GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8 => generated 1315 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:37.093984 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-b3a9758e-ab3a-423e-a842-3f8986a6f419 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1550796075", "imageRef": "705a0c6b-b003-4687-84bf-8b9f87dae39e", "flavorRef": "452", "networks": [{"uuid": "aaedd0c6-8067-4afd-bcb2-ecc8e1a55154"}]}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:18:37.191972 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.network.neutron [None req-b3a9758e-ab3a-423e-a842-3f8986a6f419 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] validate_networks() for [('aaedd0c6-8067-4afd-bcb2-ecc8e1a55154', None, None, None)] {{(pid=87932) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 13:18:37.323430 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-2a544ee1-6972-48e0-be18-6ddcca97e90f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action" status: 200 len: 29405 microversion: 2.20 time: 0.828621 Apr 30 13:18:37.324571 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 137/250] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:18:36 2021] POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action => generated 29405 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:18:37.473871 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-5882e0ba-4f67-4ea7-b141-6cd389b1de8d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:37.474691 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-5882e0ba-4f67-4ea7-b141-6cd389b1de8d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:37.489619 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5882e0ba-4f67-4ea7-b141-6cd389b1de8d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:37.495806 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5882e0ba-4f67-4ea7-b141-6cd389b1de8d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:37.496699 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5882e0ba-4f67-4ea7-b141-6cd389b1de8d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:37.499667 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5882e0ba-4f67-4ea7-b141-6cd389b1de8d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:37.778318 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-5882e0ba-4f67-4ea7-b141-6cd389b1de8d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:37.790528 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-5882e0ba-4f67-4ea7-b141-6cd389b1de8d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1501 microversion: 2.1 time: 0.321672 Apr 30 13:18:37.791672 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 138/251] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:37 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1501 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:37.822842 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b25e268e-f6e2-45e6-ab09-0c1fad8be12a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:37.823474 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-b25e268e-f6e2-45e6-ab09-0c1fad8be12a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:37.844549 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b25e268e-f6e2-45e6-ab09-0c1fad8be12a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:37.844944 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b25e268e-f6e2-45e6-ab09-0c1fad8be12a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:37.860780 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b25e268e-f6e2-45e6-ab09-0c1fad8be12a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:37.861241 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b25e268e-f6e2-45e6-ab09-0c1fad8be12a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:37.862457 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-b3a9758e-ab3a-423e-a842-3f8986a6f419 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Flavor limits 0:0:0 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 13:18:37.863240 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-b3a9758e-ab3a-423e-a842-3f8986a6f419 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Image limits 0:0:0 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 13:18:37.864110 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-b3a9758e-ab3a-423e-a842-3f8986a6f419 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Flavor pref 0:0:0 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 13:18:37.865017 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-b3a9758e-ab3a-423e-a842-3f8986a6f419 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Image pref 0:0:0 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 13:18:37.867091 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-b3a9758e-ab3a-423e-a842-3f8986a6f419 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 13:18:37.883489 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b3a9758e-ab3a-423e-a842-3f8986a6f419 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:37.883970 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b3a9758e-ab3a-423e-a842-3f8986a6f419 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:37.884894 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b3a9758e-ab3a-423e-a842-3f8986a6f419 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:37.885590 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b3a9758e-ab3a-423e-a842-3f8986a6f419 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:37.907825 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.quota [None req-b3a9758e-ab3a-423e-a842-3f8986a6f419 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Getting quotas for project 9079985bd0cc444091cb61ab2418c9a0. Resources: {'ram', 'instances', 'cores'} {{(pid=87932) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:18:37.912909 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.quota [None req-b3a9758e-ab3a-423e-a842-3f8986a6f419 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Getting quotas for user fbc9375be240416da7db978d32bd5531 and project 9079985bd0cc444091cb61ab2418c9a0. Resources: {'ram', 'instances', 'cores'} {{(pid=87932) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:18:37.925851 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-b3a9758e-ab3a-423e-a842-3f8986a6f419 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Going to run 1 instances... {{(pid=87932) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 13:18:37.929039 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-b3a9758e-ab3a-423e-a842-3f8986a6f419 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 2050955f-b5e4-4bfb-9d57-cc100dd9c25b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='705a0c6b-b003-4687-84bf-8b9f87dae39e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=87932) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 13:18:37.977285 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-b3a9758e-ab3a-423e-a842-3f8986a6f419 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.892626 Apr 30 13:18:37.983151 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 114/252] 10.222.0.79 () {60 vars in 1147 bytes} [Fri Apr 30 13:18:37 2021] POST /compute/v2.1/servers => generated 380 bytes in 899 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 13:18:37.987950 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-89c01880-0215-478f-8d7f-057c83722730 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:37.989076 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-89c01880-0215-478f-8d7f-057c83722730 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] [instance: f55df369-be4b-420f-918b-ae65b6d8fea8] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:37.997888 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-89c01880-0215-478f-8d7f-057c83722730 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:37.998396 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-89c01880-0215-478f-8d7f-057c83722730 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:37.999193 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-89c01880-0215-478f-8d7f-057c83722730 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:37.999695 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-89c01880-0215-478f-8d7f-057c83722730 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:38.213691 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-b25e268e-f6e2-45e6-ab09-0c1fad8be12a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:38.224766 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b25e268e-f6e2-45e6-ab09-0c1fad8be12a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1514 microversion: 2.1 time: 0.414216 Apr 30 13:18:38.226298 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 139/253] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:37 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1514 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:38.231689 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-f4a58018-f4b1-4b21-99cb-bf47badaafac tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:38.232345 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-f4a58018-f4b1-4b21-99cb-bf47badaafac tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 2050955f-b5e4-4bfb-9d57-cc100dd9c25b] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:38.423179 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-f4a58018-f4b1-4b21-99cb-bf47badaafac tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc9375be240416da7db978d32bd5531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079985bd0cc444091cb61ab2418c9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:38.447530 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-89c01880-0215-478f-8d7f-057c83722730 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69853458afe04251bc794811e860e0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a1fc61e034b819f787a6c7412b855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:38.453484 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-f4a58018-f4b1-4b21-99cb-bf47badaafac tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] 10.222.0.79 "GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b" status: 200 len: 1214 microversion: 2.1 time: 0.226098 Apr 30 13:18:38.462243 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-89c01880-0215-478f-8d7f-057c83722730 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] 10.222.0.79 "GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8" status: 200 len: 1315 microversion: 2.1 time: 0.477740 Apr 30 13:18:38.465233 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 140/254] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:38 2021] GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b => generated 1214 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:38.467487 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 115/255] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:37 2021] GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8 => generated 1315 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:38.490202 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b623c626-06b1-482b-ae48-41b070e2f4f5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:18:38.492364 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-b623c626-06b1-482b-ae48-41b070e2f4f5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:38.514204 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b623c626-06b1-482b-ae48-41b070e2f4f5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:38.514710 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b623c626-06b1-482b-ae48-41b070e2f4f5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:38.518445 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b623c626-06b1-482b-ae48-41b070e2f4f5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:38.519068 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b623c626-06b1-482b-ae48-41b070e2f4f5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:38.799377 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b623c626-06b1-482b-ae48-41b070e2f4f5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action" status: 200 len: 30609 microversion: 2.20 time: 0.328755 Apr 30 13:18:38.800427 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 141/256] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:18:38 2021] POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action => generated 30609 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:18:39.219221 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-3c0a322f-d681-4201-b74d-54ff807c9a14 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2005732996", "imageRef": "705a0c6b-b003-4687-84bf-8b9f87dae39e", "flavorRef": "452", "networks": [{"uuid": "4f6ff428-220c-464d-bf3c-450653cf4660"}]}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:18:39.326331 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.network.neutron [None req-3c0a322f-d681-4201-b74d-54ff807c9a14 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] validate_networks() for [('4f6ff428-220c-464d-bf3c-450653cf4660', None, None, None)] {{(pid=87932) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 13:18:39.476213 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b3db0253-aa56-4ac8-8fa6-f63c7b22da73 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:39.478042 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-b3db0253-aa56-4ac8-8fa6-f63c7b22da73 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 2050955f-b5e4-4bfb-9d57-cc100dd9c25b] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:39.493759 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b3db0253-aa56-4ac8-8fa6-f63c7b22da73 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:39.494870 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b3db0253-aa56-4ac8-8fa6-f63c7b22da73 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:39.496361 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b3db0253-aa56-4ac8-8fa6-f63c7b22da73 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:39.497144 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b3db0253-aa56-4ac8-8fa6-f63c7b22da73 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:39.655309 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-b3db0253-aa56-4ac8-8fa6-f63c7b22da73 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc9375be240416da7db978d32bd5531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079985bd0cc444091cb61ab2418c9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:39.665933 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b3db0253-aa56-4ac8-8fa6-f63c7b22da73 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] 10.222.0.79 "GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b" status: 200 len: 1266 microversion: 2.1 time: 0.197572 Apr 30 13:18:39.667525 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 142/257] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:39 2021] GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:18:39.673224 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-2f12790a-060a-4772-886d-24ea89f47031 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:39.674047 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-2f12790a-060a-4772-886d-24ea89f47031 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] [instance: f55df369-be4b-420f-918b-ae65b6d8fea8] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:39.682977 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2f12790a-060a-4772-886d-24ea89f47031 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:39.683890 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2f12790a-060a-4772-886d-24ea89f47031 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:39.684971 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2f12790a-060a-4772-886d-24ea89f47031 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:39.685498 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2f12790a-060a-4772-886d-24ea89f47031 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:39.944099 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-2f12790a-060a-4772-886d-24ea89f47031 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69853458afe04251bc794811e860e0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a1fc61e034b819f787a6c7412b855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:39.954309 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-2f12790a-060a-4772-886d-24ea89f47031 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] 10.222.0.79 "GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8" status: 200 len: 1464 microversion: 2.1 time: 0.285499 Apr 30 13:18:39.955390 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 143/258] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:39 2021] GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8 => generated 1464 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:39.961182 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-feb1ccc4-9834-48a9-9bef-ad4270d04e2e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:18:39.963720 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-feb1ccc4-9834-48a9-9bef-ad4270d04e2e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:39.972199 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-feb1ccc4-9834-48a9-9bef-ad4270d04e2e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:39.973094 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-feb1ccc4-9834-48a9-9bef-ad4270d04e2e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:39.974378 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-feb1ccc4-9834-48a9-9bef-ad4270d04e2e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:39.975010 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-feb1ccc4-9834-48a9-9bef-ad4270d04e2e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:40.026357 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-3c0a322f-d681-4201-b74d-54ff807c9a14 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Flavor limits 0:0:0 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 13:18:40.027574 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-3c0a322f-d681-4201-b74d-54ff807c9a14 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Image limits 0:0:0 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 13:18:40.028241 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-3c0a322f-d681-4201-b74d-54ff807c9a14 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Flavor pref 0:0:0 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 13:18:40.028821 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-3c0a322f-d681-4201-b74d-54ff807c9a14 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Image pref 0:0:0 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 13:18:40.029410 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-3c0a322f-d681-4201-b74d-54ff807c9a14 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 13:18:40.050556 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3c0a322f-d681-4201-b74d-54ff807c9a14 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:40.051251 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3c0a322f-d681-4201-b74d-54ff807c9a14 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:40.052559 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3c0a322f-d681-4201-b74d-54ff807c9a14 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:40.053349 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3c0a322f-d681-4201-b74d-54ff807c9a14 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:40.112927 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.quota [None req-3c0a322f-d681-4201-b74d-54ff807c9a14 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Getting quotas for project f8dcaa02d735401891147a4c2464e318. Resources: {'ram', 'instances', 'cores'} {{(pid=87932) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:18:40.122098 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.quota [None req-3c0a322f-d681-4201-b74d-54ff807c9a14 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Getting quotas for user f2a53be36b2d4d6681dacffb5843510f and project f8dcaa02d735401891147a4c2464e318. Resources: {'ram', 'instances', 'cores'} {{(pid=87932) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:18:40.153331 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-3c0a322f-d681-4201-b74d-54ff807c9a14 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Going to run 1 instances... {{(pid=87932) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 13:18:40.162608 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-3c0a322f-d681-4201-b74d-54ff807c9a14 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 93d74a82-eb0b-4b65-bbe2-8960312e9dd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='705a0c6b-b003-4687-84bf-8b9f87dae39e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=87932) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 13:18:40.190064 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-feb1ccc4-9834-48a9-9bef-ad4270d04e2e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action" status: 200 len: 31930 microversion: 2.20 time: 0.232939 Apr 30 13:18:40.191494 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 144/259] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:18:39 2021] POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action => generated 31930 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:18:40.202070 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-c5ecef36-5044-44f8-bd53-192def3a8a05 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:40.204996 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-c5ecef36-5044-44f8-bd53-192def3a8a05 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] [instance: f55df369-be4b-420f-918b-ae65b6d8fea8] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:40.221887 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c5ecef36-5044-44f8-bd53-192def3a8a05 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:40.224106 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c5ecef36-5044-44f8-bd53-192def3a8a05 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:40.225018 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c5ecef36-5044-44f8-bd53-192def3a8a05 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:40.225474 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c5ecef36-5044-44f8-bd53-192def3a8a05 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:40.285366 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-3c0a322f-d681-4201-b74d-54ff807c9a14 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.069692 Apr 30 13:18:40.286875 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 116/260] 10.222.0.79 () {60 vars in 1147 bytes} [Fri Apr 30 13:18:39 2021] POST /compute/v2.1/servers => generated 380 bytes in 1073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 13:18:40.297280 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-156820d9-e94a-439d-a946-55b23106ff29 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:40.299627 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-156820d9-e94a-439d-a946-55b23106ff29 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 93d74a82-eb0b-4b65-bbe2-8960312e9dd8] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:40.334102 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-c5ecef36-5044-44f8-bd53-192def3a8a05 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] [instance: f55df369-be4b-420f-918b-ae65b6d8fea8] Going to try to terminate instance {{(pid=87933) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 13:18:40.573172 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-c5ecef36-5044-44f8-bd53-192def3a8a05 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8" status: 204 len: 0 microversion: 2.1 time: 0.379650 Apr 30 13:18:40.575092 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 145/261] 10.222.0.79 () {58 vars in 1239 bytes} [Fri Apr 30 13:18:40 2021] DELETE /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 13:18:40.581555 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-50d7e5a7-10b6-4667-bdb2-bd3886087eac tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:18:40.583073 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-50d7e5a7-10b6-4667-bdb2-bd3886087eac tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:40.591527 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-50d7e5a7-10b6-4667-bdb2-bd3886087eac tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:40.592461 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-50d7e5a7-10b6-4667-bdb2-bd3886087eac tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:40.593785 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-50d7e5a7-10b6-4667-bdb2-bd3886087eac tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:40.594538 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-50d7e5a7-10b6-4667-bdb2-bd3886087eac tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:40.654157 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-156820d9-e94a-439d-a946-55b23106ff29 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:40.667503 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-156820d9-e94a-439d-a946-55b23106ff29 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8" status: 200 len: 1218 microversion: 2.1 time: 0.374473 Apr 30 13:18:40.671746 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 117/262] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:40 2021] GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8 => generated 1218 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:18:40.689032 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-855ab67d-03cb-480e-92ca-d45ad3f926c3 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:40.700451 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-855ab67d-03cb-480e-92ca-d45ad3f926c3 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] [instance: f55df369-be4b-420f-918b-ae65b6d8fea8] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:40.727826 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-855ab67d-03cb-480e-92ca-d45ad3f926c3 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:40.728296 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-855ab67d-03cb-480e-92ca-d45ad3f926c3 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:40.729118 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-855ab67d-03cb-480e-92ca-d45ad3f926c3 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:40.729558 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-855ab67d-03cb-480e-92ca-d45ad3f926c3 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:40.748363 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.objects.instance [None req-50d7e5a7-10b6-4667-bdb2-bd3886087eac tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lazy-loading 'flavor' on Instance uuid aa7277ee-287a-481c-a0e8-ae4dc4053a0e {{(pid=87933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:18:41.021974 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-50d7e5a7-10b6-4667-bdb2-bd3886087eac tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "POST /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e/action" status: 200 len: 32 microversion: 2.1 time: 0.445049 Apr 30 13:18:41.022822 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 146/263] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:18:40 2021] POST /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e/action => generated 32 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 13:18:41.040748 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-edbc65ce-57e3-4492-94df-581a837d2634 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:41.041483 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-edbc65ce-57e3-4492-94df-581a837d2634 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 2050955f-b5e4-4bfb-9d57-cc100dd9c25b] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:41.051155 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-edbc65ce-57e3-4492-94df-581a837d2634 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:41.051902 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-edbc65ce-57e3-4492-94df-581a837d2634 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:41.052844 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-edbc65ce-57e3-4492-94df-581a837d2634 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:41.054260 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-edbc65ce-57e3-4492-94df-581a837d2634 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:41.178845 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-edbc65ce-57e3-4492-94df-581a837d2634 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc9375be240416da7db978d32bd5531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079985bd0cc444091cb61ab2418c9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:41.190212 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-edbc65ce-57e3-4492-94df-581a837d2634 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] 10.222.0.79 "GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b" status: 200 len: 1272 microversion: 2.1 time: 0.154817 Apr 30 13:18:41.191025 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 147/264] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:41 2021] GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b => generated 1272 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:41.198996 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-a53ad0fc-acec-4938-bd24-d78bd31145ea tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:41.199984 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-a53ad0fc-acec-4938-bd24-d78bd31145ea tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:41.213946 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a53ad0fc-acec-4938-bd24-d78bd31145ea tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:41.214839 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a53ad0fc-acec-4938-bd24-d78bd31145ea tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:41.215578 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a53ad0fc-acec-4938-bd24-d78bd31145ea tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:41.226660 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a53ad0fc-acec-4938-bd24-d78bd31145ea tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:41.301071 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-855ab67d-03cb-480e-92ca-d45ad3f926c3 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69853458afe04251bc794811e860e0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a1fc61e034b819f787a6c7412b855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:41.313892 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-855ab67d-03cb-480e-92ca-d45ad3f926c3 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] 10.222.0.79 "GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8" status: 200 len: 1470 microversion: 2.1 time: 0.640738 Apr 30 13:18:41.324656 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 118/265] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:40 2021] GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8 => generated 1470 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:41.330594 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-0745e2b5-50a2-4619-b58f-eb36bbe2ad07 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:18:41.331931 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-0745e2b5-50a2-4619-b58f-eb36bbe2ad07 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:41.340582 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0745e2b5-50a2-4619-b58f-eb36bbe2ad07 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:41.341741 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0745e2b5-50a2-4619-b58f-eb36bbe2ad07 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:41.342820 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0745e2b5-50a2-4619-b58f-eb36bbe2ad07 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:41.343477 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0745e2b5-50a2-4619-b58f-eb36bbe2ad07 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:41.478984 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-a53ad0fc-acec-4938-bd24-d78bd31145ea tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:41.487473 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-a53ad0fc-acec-4938-bd24-d78bd31145ea tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1520 microversion: 2.1 time: 0.295400 Apr 30 13:18:41.488109 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 148/266] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:41 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1520 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:41.593547 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-0745e2b5-50a2-4619-b58f-eb36bbe2ad07 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action" status: 200 len: 32849 microversion: 2.20 time: 0.267177 Apr 30 13:18:41.594222 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 119/267] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:18:41 2021] POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action => generated 32849 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:18:41.699746 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-497c1575-bb2a-4a27-9668-717d36993fb1 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:41.700982 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-497c1575-bb2a-4a27-9668-717d36993fb1 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 93d74a82-eb0b-4b65-bbe2-8960312e9dd8] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:41.709172 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-497c1575-bb2a-4a27-9668-717d36993fb1 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:41.710540 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-497c1575-bb2a-4a27-9668-717d36993fb1 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:41.710692 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-497c1575-bb2a-4a27-9668-717d36993fb1 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:41.711029 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-497c1575-bb2a-4a27-9668-717d36993fb1 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:41.877901 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-497c1575-bb2a-4a27-9668-717d36993fb1 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:41.887591 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-497c1575-bb2a-4a27-9668-717d36993fb1 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8" status: 200 len: 1270 microversion: 2.1 time: 0.192360 Apr 30 13:18:41.888486 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 149/268] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:41 2021] GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8 => generated 1270 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:42.209677 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-aa407f65-98ea-4e20-bf3b-5370b1b03997 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:42.210749 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-aa407f65-98ea-4e20-bf3b-5370b1b03997 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 2050955f-b5e4-4bfb-9d57-cc100dd9c25b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:42.224233 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-aa407f65-98ea-4e20-bf3b-5370b1b03997 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:42.224702 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-aa407f65-98ea-4e20-bf3b-5370b1b03997 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:42.226256 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-aa407f65-98ea-4e20-bf3b-5370b1b03997 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:42.226717 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-aa407f65-98ea-4e20-bf3b-5370b1b03997 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:42.332203 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-c2d034b7-4654-4777-9f90-202191855d0a tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:42.333043 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-c2d034b7-4654-4777-9f90-202191855d0a tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] [instance: f55df369-be4b-420f-918b-ae65b6d8fea8] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:42.351395 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c2d034b7-4654-4777-9f90-202191855d0a tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:42.352633 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c2d034b7-4654-4777-9f90-202191855d0a tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:42.360310 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c2d034b7-4654-4777-9f90-202191855d0a tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:42.360958 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c2d034b7-4654-4777-9f90-202191855d0a tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:42.815015 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-c2d034b7-4654-4777-9f90-202191855d0a tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69853458afe04251bc794811e860e0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a1fc61e034b819f787a6c7412b855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:42.828995 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-c2d034b7-4654-4777-9f90-202191855d0a tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] 10.222.0.79 "GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8" status: 200 len: 1470 microversion: 2.1 time: 0.500652 Apr 30 13:18:42.839543 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 150/269] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:42 2021] GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8 => generated 1470 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:18:42.839543 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-6ca2925a-80c5-46e0-b76f-f07de3de0c27 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:42.839543 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-6ca2925a-80c5-46e0-b76f-f07de3de0c27 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:42.845756 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6ca2925a-80c5-46e0-b76f-f07de3de0c27 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:42.846360 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6ca2925a-80c5-46e0-b76f-f07de3de0c27 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:42.848261 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6ca2925a-80c5-46e0-b76f-f07de3de0c27 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:42.849076 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6ca2925a-80c5-46e0-b76f-f07de3de0c27 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:43.156070 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-aa407f65-98ea-4e20-bf3b-5370b1b03997 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc9375be240416da7db978d32bd5531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079985bd0cc444091cb61ab2418c9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:43.166502 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-aa407f65-98ea-4e20-bf3b-5370b1b03997 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] 10.222.0.79 "GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b" status: 200 len: 1314 microversion: 2.1 time: 0.961227 Apr 30 13:18:43.167544 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 120/270] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:42 2021] GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b => generated 1314 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:43.180708 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-d247ff40-91d9-4a98-94cf-48127a315cf3 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:18:43.181717 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-d247ff40-91d9-4a98-94cf-48127a315cf3 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:43.189697 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d247ff40-91d9-4a98-94cf-48127a315cf3 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:43.190191 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d247ff40-91d9-4a98-94cf-48127a315cf3 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:43.190988 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d247ff40-91d9-4a98-94cf-48127a315cf3 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:43.191433 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d247ff40-91d9-4a98-94cf-48127a315cf3 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:43.429484 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-6ca2925a-80c5-46e0-b76f-f07de3de0c27 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:43.440653 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-6ca2925a-80c5-46e0-b76f-f07de3de0c27 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1520 microversion: 2.1 time: 0.609034 Apr 30 13:18:43.441299 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 151/271] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:42 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1520 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:43.453693 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-0f12600b-ca7a-483f-872b-0f9720d0640e tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:43.459265 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-0f12600b-ca7a-483f-872b-0f9720d0640e tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 93d74a82-eb0b-4b65-bbe2-8960312e9dd8] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:43.476964 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0f12600b-ca7a-483f-872b-0f9720d0640e tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:43.477428 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0f12600b-ca7a-483f-872b-0f9720d0640e tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:43.478338 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0f12600b-ca7a-483f-872b-0f9720d0640e tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:43.478785 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0f12600b-ca7a-483f-872b-0f9720d0640e tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:43.831221 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-0f12600b-ca7a-483f-872b-0f9720d0640e tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:43.842665 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-0f12600b-ca7a-483f-872b-0f9720d0640e tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8" status: 200 len: 1318 microversion: 2.1 time: 0.396718 Apr 30 13:18:43.843347 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 152/272] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:43 2021] GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8 => generated 1318 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:43.857274 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [req-e20dd2d8-c59f-46e4-8642-dbd3896531a2 req-cbeccb50-c973-4eb3-a531-a48a8639ca7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2050955f-b5e4-4bfb-9d57-cc100dd9c25b", "tag": "6bf679fb-169f-4d67-b161-f2a15b38dde6"}]} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:18:43.859206 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:18:43.859206 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: warnings.warn(msg) Apr 30 13:18:43.870328 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-e20dd2d8-c59f-46e4-8642-dbd3896531a2 req-cbeccb50-c973-4eb3-a531-a48a8639ca7c service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:43.870980 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-e20dd2d8-c59f-46e4-8642-dbd3896531a2 req-cbeccb50-c973-4eb3-a531-a48a8639ca7c service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:43.893733 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.compute.server_external_events [req-e20dd2d8-c59f-46e4-8642-dbd3896531a2 req-cbeccb50-c973-4eb3-a531-a48a8639ca7c service nova] Creating event network-changed:6bf679fb-169f-4d67-b161-f2a15b38dde6 for instance 2050955f-b5e4-4bfb-9d57-cc100dd9c25b on hv-cinder-78836 Apr 30 13:18:43.899261 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [req-e20dd2d8-c59f-46e4-8642-dbd3896531a2 req-cbeccb50-c973-4eb3-a531-a48a8639ca7c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054572 Apr 30 13:18:43.900043 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 153/273] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:18:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:18:43.905096 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-5e10d9fa-83c5-479c-82d3-22b09da4ffc0 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:43.905796 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-5e10d9fa-83c5-479c-82d3-22b09da4ffc0 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] [instance: f55df369-be4b-420f-918b-ae65b6d8fea8] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:43.913883 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5e10d9fa-83c5-479c-82d3-22b09da4ffc0 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:43.914376 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5e10d9fa-83c5-479c-82d3-22b09da4ffc0 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:43.915178 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5e10d9fa-83c5-479c-82d3-22b09da4ffc0 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:43.915621 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5e10d9fa-83c5-479c-82d3-22b09da4ffc0 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:44.217062 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-5e10d9fa-83c5-479c-82d3-22b09da4ffc0 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69853458afe04251bc794811e860e0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a1fc61e034b819f787a6c7412b855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:44.226179 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-5e10d9fa-83c5-479c-82d3-22b09da4ffc0 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] 10.222.0.79 "GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8" status: 200 len: 1470 microversion: 2.1 time: 0.324890 Apr 30 13:18:44.226869 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 154/274] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:43 2021] GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8 => generated 1470 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:44.231598 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b4a8c8ac-560a-4bd5-bc1d-4a5e10b673b1 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:44.232265 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-b4a8c8ac-560a-4bd5-bc1d-4a5e10b673b1 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 2050955f-b5e4-4bfb-9d57-cc100dd9c25b] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:44.242107 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b4a8c8ac-560a-4bd5-bc1d-4a5e10b673b1 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:44.242763 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b4a8c8ac-560a-4bd5-bc1d-4a5e10b673b1 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:44.243740 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b4a8c8ac-560a-4bd5-bc1d-4a5e10b673b1 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:44.244291 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b4a8c8ac-560a-4bd5-bc1d-4a5e10b673b1 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:44.477831 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-b4a8c8ac-560a-4bd5-bc1d-4a5e10b673b1 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc9375be240416da7db978d32bd5531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079985bd0cc444091cb61ab2418c9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:44.494402 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b4a8c8ac-560a-4bd5-bc1d-4a5e10b673b1 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] 10.222.0.79 "GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b" status: 200 len: 1314 microversion: 2.1 time: 0.266078 Apr 30 13:18:44.494965 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 155/275] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:44 2021] GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:44.499554 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-255b2dc6-2df3-4292-aabd-2471cf5509ab tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:44.500386 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-255b2dc6-2df3-4292-aabd-2471cf5509ab tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:44.508446 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-255b2dc6-2df3-4292-aabd-2471cf5509ab tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:44.508911 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-255b2dc6-2df3-4292-aabd-2471cf5509ab tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:44.509713 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-255b2dc6-2df3-4292-aabd-2471cf5509ab tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:44.510188 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-255b2dc6-2df3-4292-aabd-2471cf5509ab tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:44.731075 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-255b2dc6-2df3-4292-aabd-2471cf5509ab tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:44.739987 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-255b2dc6-2df3-4292-aabd-2471cf5509ab tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1520 microversion: 2.1 time: 0.244015 Apr 30 13:18:44.741149 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 156/276] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:44 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1520 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:44.861293 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-bb58f6f1-4c78-4085-8e6d-a0cef36e5483 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:44.862242 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-bb58f6f1-4c78-4085-8e6d-a0cef36e5483 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 93d74a82-eb0b-4b65-bbe2-8960312e9dd8] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:44.872690 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-bb58f6f1-4c78-4085-8e6d-a0cef36e5483 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:44.872951 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-bb58f6f1-4c78-4085-8e6d-a0cef36e5483 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:44.873748 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-bb58f6f1-4c78-4085-8e6d-a0cef36e5483 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:44.874529 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-bb58f6f1-4c78-4085-8e6d-a0cef36e5483 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:45.162307 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-bb58f6f1-4c78-4085-8e6d-a0cef36e5483 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:45.172290 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-bb58f6f1-4c78-4085-8e6d-a0cef36e5483 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8" status: 200 len: 1318 microversion: 2.1 time: 0.315412 Apr 30 13:18:45.172992 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 157/277] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:44 2021] GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8 => generated 1318 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:18:45.244919 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-af50c303-3d64-4f14-bc07-e992736b5388 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:45.245630 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-af50c303-3d64-4f14-bc07-e992736b5388 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] [instance: f55df369-be4b-420f-918b-ae65b6d8fea8] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:45.253058 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-af50c303-3d64-4f14-bc07-e992736b5388 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:45.253593 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-af50c303-3d64-4f14-bc07-e992736b5388 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:45.254495 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-af50c303-3d64-4f14-bc07-e992736b5388 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:45.255001 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-af50c303-3d64-4f14-bc07-e992736b5388 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:45.558573 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-af50c303-3d64-4f14-bc07-e992736b5388 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69853458afe04251bc794811e860e0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a1fc61e034b819f787a6c7412b855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:45.567402 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-af50c303-3d64-4f14-bc07-e992736b5388 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] 10.222.0.79 "GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8" status: 200 len: 1470 microversion: 2.1 time: 0.326614 Apr 30 13:18:45.568359 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 158/278] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:45 2021] GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8 => generated 1470 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:45.573740 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-97744f71-a546-4eb1-a620-f9ee0c09c3d4 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:45.574580 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-97744f71-a546-4eb1-a620-f9ee0c09c3d4 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 2050955f-b5e4-4bfb-9d57-cc100dd9c25b] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:45.586028 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-97744f71-a546-4eb1-a620-f9ee0c09c3d4 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:45.586598 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-97744f71-a546-4eb1-a620-f9ee0c09c3d4 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:45.587646 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-97744f71-a546-4eb1-a620-f9ee0c09c3d4 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:45.588262 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-97744f71-a546-4eb1-a620-f9ee0c09c3d4 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:45.823209 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-97744f71-a546-4eb1-a620-f9ee0c09c3d4 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc9375be240416da7db978d32bd5531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079985bd0cc444091cb61ab2418c9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:45.835846 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-97744f71-a546-4eb1-a620-f9ee0c09c3d4 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] 10.222.0.79 "GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b" status: 200 len: 1314 microversion: 2.1 time: 0.265519 Apr 30 13:18:45.836956 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 159/279] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:45 2021] GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:45.844903 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-79f807d6-b6b3-425f-aa7c-32c376d714fb tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:45.845904 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-79f807d6-b6b3-425f-aa7c-32c376d714fb tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:45.860159 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-79f807d6-b6b3-425f-aa7c-32c376d714fb tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:45.861508 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-79f807d6-b6b3-425f-aa7c-32c376d714fb tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:45.863067 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-79f807d6-b6b3-425f-aa7c-32c376d714fb tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:45.863623 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-79f807d6-b6b3-425f-aa7c-32c376d714fb tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:46.080303 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-79f807d6-b6b3-425f-aa7c-32c376d714fb tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:46.088850 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-79f807d6-b6b3-425f-aa7c-32c376d714fb tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1520 microversion: 2.1 time: 0.250704 Apr 30 13:18:46.089431 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 160/280] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:45 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1520 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:46.190461 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-6649609f-f348-4acd-aa14-1f2a47d2881f tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:46.191169 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-6649609f-f348-4acd-aa14-1f2a47d2881f tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 93d74a82-eb0b-4b65-bbe2-8960312e9dd8] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:46.199401 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6649609f-f348-4acd-aa14-1f2a47d2881f tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:46.199866 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6649609f-f348-4acd-aa14-1f2a47d2881f tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:46.200662 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6649609f-f348-4acd-aa14-1f2a47d2881f tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:46.201108 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6649609f-f348-4acd-aa14-1f2a47d2881f tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:46.431589 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-6649609f-f348-4acd-aa14-1f2a47d2881f tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:46.440366 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-6649609f-f348-4acd-aa14-1f2a47d2881f tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8" status: 200 len: 1318 microversion: 2.1 time: 0.253816 Apr 30 13:18:46.440956 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 161/281] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:46 2021] GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8 => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:18:46.589771 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-75f344db-f8f1-40db-8332-eea3661f90d7 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:46.590906 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-75f344db-f8f1-40db-8332-eea3661f90d7 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] [instance: f55df369-be4b-420f-918b-ae65b6d8fea8] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:46.603904 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-75f344db-f8f1-40db-8332-eea3661f90d7 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:46.604885 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-75f344db-f8f1-40db-8332-eea3661f90d7 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:46.606034 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-75f344db-f8f1-40db-8332-eea3661f90d7 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:46.607036 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-75f344db-f8f1-40db-8332-eea3661f90d7 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:46.722531 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-d247ff40-91d9-4a98-94cf-48127a315cf3 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action" status: 200 len: 34076 microversion: 2.20 time: 3.551942 Apr 30 13:18:46.727396 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 121/282] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:18:43 2021] POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action => generated 34076 bytes in 3555 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:18:46.859837 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-c60eb38d-2266-41d9-a70d-15ea7b6ec3de tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:46.861192 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-c60eb38d-2266-41d9-a70d-15ea7b6ec3de tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 2050955f-b5e4-4bfb-9d57-cc100dd9c25b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:46.892102 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c60eb38d-2266-41d9-a70d-15ea7b6ec3de tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:46.904746 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c60eb38d-2266-41d9-a70d-15ea7b6ec3de tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:46.906767 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c60eb38d-2266-41d9-a70d-15ea7b6ec3de tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:46.907785 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c60eb38d-2266-41d9-a70d-15ea7b6ec3de tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:47.337142 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-75f344db-f8f1-40db-8332-eea3661f90d7 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69853458afe04251bc794811e860e0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a1fc61e034b819f787a6c7412b855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:47.359833 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-75f344db-f8f1-40db-8332-eea3661f90d7 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] 10.222.0.79 "GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8" status: 200 len: 1470 microversion: 2.1 time: 0.775369 Apr 30 13:18:47.361002 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 162/283] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:46 2021] GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8 => generated 1470 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:47.366886 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-658ab1c5-58b4-49f2-8e1b-981d7a357076 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:47.367971 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-658ab1c5-58b4-49f2-8e1b-981d7a357076 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:47.381901 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-658ab1c5-58b4-49f2-8e1b-981d7a357076 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:47.382702 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-658ab1c5-58b4-49f2-8e1b-981d7a357076 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:47.384632 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-658ab1c5-58b4-49f2-8e1b-981d7a357076 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:47.385097 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-658ab1c5-58b4-49f2-8e1b-981d7a357076 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:47.638291 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-c60eb38d-2266-41d9-a70d-15ea7b6ec3de tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc9375be240416da7db978d32bd5531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079985bd0cc444091cb61ab2418c9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:47.654185 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-c60eb38d-2266-41d9-a70d-15ea7b6ec3de tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] 10.222.0.79 "GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b" status: 200 len: 1314 microversion: 2.1 time: 0.803375 Apr 30 13:18:47.657188 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 122/284] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:46 2021] GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b => generated 1314 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:47.664439 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-3a7dd857-de27-493f-b0b6-a603b7542ab5 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:47.667059 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-3a7dd857-de27-493f-b0b6-a603b7542ab5 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 93d74a82-eb0b-4b65-bbe2-8960312e9dd8] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:47.679532 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3a7dd857-de27-493f-b0b6-a603b7542ab5 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:47.680312 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3a7dd857-de27-493f-b0b6-a603b7542ab5 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:47.681938 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3a7dd857-de27-493f-b0b6-a603b7542ab5 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:47.682579 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3a7dd857-de27-493f-b0b6-a603b7542ab5 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:48.095749 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-3a7dd857-de27-493f-b0b6-a603b7542ab5 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:48.125730 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-3a7dd857-de27-493f-b0b6-a603b7542ab5 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8" status: 200 len: 1318 microversion: 2.1 time: 0.466848 Apr 30 13:18:48.129641 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 123/285] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:47 2021] GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8 => generated 1318 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:48.145207 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-30333d4f-eeb2-428a-afc3-b4a334a5b297 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:18:48.147943 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-30333d4f-eeb2-428a-afc3-b4a334a5b297 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:48.164665 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-30333d4f-eeb2-428a-afc3-b4a334a5b297 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:48.170660 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-30333d4f-eeb2-428a-afc3-b4a334a5b297 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:48.174412 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-30333d4f-eeb2-428a-afc3-b4a334a5b297 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:48.176497 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-30333d4f-eeb2-428a-afc3-b4a334a5b297 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:48.275873 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-658ab1c5-58b4-49f2-8e1b-981d7a357076 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:48.301727 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-658ab1c5-58b4-49f2-8e1b-981d7a357076 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1520 microversion: 2.1 time: 0.936379 Apr 30 13:18:48.303564 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 163/286] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:47 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1520 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:48.379061 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-65ea691c-b8fd-4877-97ad-e68320c6e941 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:48.381390 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-65ea691c-b8fd-4877-97ad-e68320c6e941 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] [instance: f55df369-be4b-420f-918b-ae65b6d8fea8] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:48.407711 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-65ea691c-b8fd-4877-97ad-e68320c6e941 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:48.408187 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-65ea691c-b8fd-4877-97ad-e68320c6e941 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:48.409008 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-65ea691c-b8fd-4877-97ad-e68320c6e941 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:48.409446 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-65ea691c-b8fd-4877-97ad-e68320c6e941 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:48.835099 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-65ea691c-b8fd-4877-97ad-e68320c6e941 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69853458afe04251bc794811e860e0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a1fc61e034b819f787a6c7412b855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:48.845881 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-65ea691c-b8fd-4877-97ad-e68320c6e941 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] 10.222.0.79 "GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8" status: 200 len: 1470 microversion: 2.1 time: 0.471443 Apr 30 13:18:48.855994 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 164/287] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:48 2021] GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8 => generated 1470 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:48.867101 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-a761d97c-1537-4201-ae9f-51ff48a70876 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:48.868100 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-a761d97c-1537-4201-ae9f-51ff48a70876 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 2050955f-b5e4-4bfb-9d57-cc100dd9c25b] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:48.876796 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a761d97c-1537-4201-ae9f-51ff48a70876 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:48.877492 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a761d97c-1537-4201-ae9f-51ff48a70876 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:48.878350 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a761d97c-1537-4201-ae9f-51ff48a70876 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:48.878898 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a761d97c-1537-4201-ae9f-51ff48a70876 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:49.219826 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-a761d97c-1537-4201-ae9f-51ff48a70876 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc9375be240416da7db978d32bd5531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079985bd0cc444091cb61ab2418c9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:49.229367 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-a761d97c-1537-4201-ae9f-51ff48a70876 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] 10.222.0.79 "GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b" status: 200 len: 1314 microversion: 2.1 time: 0.371684 Apr 30 13:18:49.229947 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 165/288] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:48 2021] GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b => generated 1314 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:49.234450 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [req-ad1b3381-ba12-48e9-8b90-00fb2ad8e7cb req-33ddee68-5f20-4e99-ac77-1e86a647b52b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93d74a82-eb0b-4b65-bbe2-8960312e9dd8", "tag": "993e83a7-97b0-4089-ba75-29f8911a36c4"}]} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:18:49.236004 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:18:49.236004 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: warnings.warn(msg) Apr 30 13:18:49.244932 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-ad1b3381-ba12-48e9-8b90-00fb2ad8e7cb req-33ddee68-5f20-4e99-ac77-1e86a647b52b service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:49.245381 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-ad1b3381-ba12-48e9-8b90-00fb2ad8e7cb req-33ddee68-5f20-4e99-ac77-1e86a647b52b service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:49.261457 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.compute.server_external_events [req-ad1b3381-ba12-48e9-8b90-00fb2ad8e7cb req-33ddee68-5f20-4e99-ac77-1e86a647b52b service nova] Creating event network-changed:993e83a7-97b0-4089-ba75-29f8911a36c4 for instance 93d74a82-eb0b-4b65-bbe2-8960312e9dd8 on hv-cinder-78836 Apr 30 13:18:49.266153 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [req-ad1b3381-ba12-48e9-8b90-00fb2ad8e7cb req-33ddee68-5f20-4e99-ac77-1e86a647b52b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034989 Apr 30 13:18:49.266746 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 166/289] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:18:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:18:49.272282 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-3662e3f3-8fda-426d-a9c2-59e3cc471bf4 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:49.273157 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-3662e3f3-8fda-426d-a9c2-59e3cc471bf4 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 93d74a82-eb0b-4b65-bbe2-8960312e9dd8] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:49.280585 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3662e3f3-8fda-426d-a9c2-59e3cc471bf4 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:49.281041 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3662e3f3-8fda-426d-a9c2-59e3cc471bf4 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:49.281834 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3662e3f3-8fda-426d-a9c2-59e3cc471bf4 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:49.282308 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3662e3f3-8fda-426d-a9c2-59e3cc471bf4 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:49.509843 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-3662e3f3-8fda-426d-a9c2-59e3cc471bf4 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:49.518801 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-3662e3f3-8fda-426d-a9c2-59e3cc471bf4 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8" status: 200 len: 1318 microversion: 2.1 time: 0.250839 Apr 30 13:18:49.519375 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 167/290] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:49 2021] GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8 => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:49.524870 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-9fed7ba8-872a-403e-9454-8579e49edff1 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:49.525501 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-9fed7ba8-872a-403e-9454-8579e49edff1 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:49.532973 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9fed7ba8-872a-403e-9454-8579e49edff1 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:49.533425 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9fed7ba8-872a-403e-9454-8579e49edff1 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:49.534257 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9fed7ba8-872a-403e-9454-8579e49edff1 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:49.534866 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9fed7ba8-872a-403e-9454-8579e49edff1 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:49.753755 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-9fed7ba8-872a-403e-9454-8579e49edff1 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:49.764130 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-9fed7ba8-872a-403e-9454-8579e49edff1 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1520 microversion: 2.1 time: 0.243466 Apr 30 13:18:49.765057 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 168/291] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:49 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1520 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:49.866495 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-d609bcc5-0f55-4d4a-828f-d2e9b10b5c99 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:49.866951 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-d609bcc5-0f55-4d4a-828f-d2e9b10b5c99 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] [instance: f55df369-be4b-420f-918b-ae65b6d8fea8] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:49.875565 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d609bcc5-0f55-4d4a-828f-d2e9b10b5c99 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:49.876035 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d609bcc5-0f55-4d4a-828f-d2e9b10b5c99 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:49.877034 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d609bcc5-0f55-4d4a-828f-d2e9b10b5c99 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:49.877806 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d609bcc5-0f55-4d4a-828f-d2e9b10b5c99 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:50.096356 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-d609bcc5-0f55-4d4a-828f-d2e9b10b5c99 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69853458afe04251bc794811e860e0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a1fc61e034b819f787a6c7412b855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:50.105630 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-d609bcc5-0f55-4d4a-828f-d2e9b10b5c99 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] 10.222.0.79 "GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8" status: 200 len: 1470 microversion: 2.1 time: 0.243274 Apr 30 13:18:50.121667 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 169/292] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:49 2021] GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8 => generated 1470 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:18:50.246831 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-dc7e6570-aa3d-4e41-8ea5-854d7d6c3fd1 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:50.247450 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-dc7e6570-aa3d-4e41-8ea5-854d7d6c3fd1 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 2050955f-b5e4-4bfb-9d57-cc100dd9c25b] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:50.254913 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-dc7e6570-aa3d-4e41-8ea5-854d7d6c3fd1 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:50.255665 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-dc7e6570-aa3d-4e41-8ea5-854d7d6c3fd1 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:50.257417 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-dc7e6570-aa3d-4e41-8ea5-854d7d6c3fd1 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:50.258056 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-dc7e6570-aa3d-4e41-8ea5-854d7d6c3fd1 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:50.478392 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-dc7e6570-aa3d-4e41-8ea5-854d7d6c3fd1 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc9375be240416da7db978d32bd5531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079985bd0cc444091cb61ab2418c9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:50.487561 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-dc7e6570-aa3d-4e41-8ea5-854d7d6c3fd1 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] 10.222.0.79 "GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b" status: 200 len: 1314 microversion: 2.1 time: 0.244489 Apr 30 13:18:50.488139 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 170/293] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:50 2021] GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:18:50.538415 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-12770b7e-fc18-499f-9a70-05a578732bd2 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:50.539385 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-12770b7e-fc18-499f-9a70-05a578732bd2 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 93d74a82-eb0b-4b65-bbe2-8960312e9dd8] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:50.546490 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-12770b7e-fc18-499f-9a70-05a578732bd2 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:50.546946 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-12770b7e-fc18-499f-9a70-05a578732bd2 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:50.547731 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-12770b7e-fc18-499f-9a70-05a578732bd2 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:50.548173 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-12770b7e-fc18-499f-9a70-05a578732bd2 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:50.763492 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-12770b7e-fc18-499f-9a70-05a578732bd2 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:50.773564 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-12770b7e-fc18-499f-9a70-05a578732bd2 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8" status: 200 len: 1318 microversion: 2.1 time: 0.239669 Apr 30 13:18:50.774207 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 171/294] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:50 2021] GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:18:50.794624 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-9935976f-562e-4ff4-9508-df94001d70bf tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:50.796113 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-9935976f-562e-4ff4-9508-df94001d70bf tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:50.811373 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9935976f-562e-4ff4-9508-df94001d70bf tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:50.812135 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9935976f-562e-4ff4-9508-df94001d70bf tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:50.813513 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9935976f-562e-4ff4-9508-df94001d70bf tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:50.814309 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9935976f-562e-4ff4-9508-df94001d70bf tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:50.912178 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-30333d4f-eeb2-428a-afc3-b4a334a5b297 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action" status: 200 len: 37976 microversion: 2.20 time: 2.780045 Apr 30 13:18:50.913969 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 124/295] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:18:48 2021] POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action => generated 37976 bytes in 2783 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:18:51.123366 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-9c1827a6-083a-4cf1-a3db-4f99d933918e tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:51.124796 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-9c1827a6-083a-4cf1-a3db-4f99d933918e tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] [instance: f55df369-be4b-420f-918b-ae65b6d8fea8] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:51.147570 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9c1827a6-083a-4cf1-a3db-4f99d933918e tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:51.148215 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9c1827a6-083a-4cf1-a3db-4f99d933918e tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:51.149419 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9c1827a6-083a-4cf1-a3db-4f99d933918e tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:51.150203 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9c1827a6-083a-4cf1-a3db-4f99d933918e tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:51.279830 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-9935976f-562e-4ff4-9508-df94001d70bf tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:51.294968 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-9935976f-562e-4ff4-9508-df94001d70bf tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1520 microversion: 2.1 time: 0.508571 Apr 30 13:18:51.298272 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 172/296] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:50 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1520 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:51.510890 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-28748114-9664-4d53-bcb3-14141aefcddd tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:51.511535 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-28748114-9664-4d53-bcb3-14141aefcddd tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 2050955f-b5e4-4bfb-9d57-cc100dd9c25b] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:51.523515 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-28748114-9664-4d53-bcb3-14141aefcddd tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:51.523974 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-28748114-9664-4d53-bcb3-14141aefcddd tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:51.524784 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-28748114-9664-4d53-bcb3-14141aefcddd tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:51.525226 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-28748114-9664-4d53-bcb3-14141aefcddd tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:51.955345 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-28748114-9664-4d53-bcb3-14141aefcddd tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc9375be240416da7db978d32bd5531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079985bd0cc444091cb61ab2418c9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:51.979126 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-28748114-9664-4d53-bcb3-14141aefcddd tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] 10.222.0.79 "GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b" status: 200 len: 1314 microversion: 2.1 time: 0.468622 Apr 30 13:18:51.980488 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 173/297] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:51 2021] GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b => generated 1314 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:51.998562 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b1f4b4e5-9670-4460-b1aa-34840d1e8e36 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1454444751", "imageRef": "705a0c6b-b003-4687-84bf-8b9f87dae39e", "flavorRef": "452", "networks": [{"uuid": "b08e9f30-22e3-4606-a3ee-bc90a0d6aebb"}]}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:18:52.087547 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.network.neutron [None req-b1f4b4e5-9670-4460-b1aa-34840d1e8e36 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] validate_networks() for [('b08e9f30-22e3-4606-a3ee-bc90a0d6aebb', None, None, None)] {{(pid=87933) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 13:18:52.310141 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-9c1827a6-083a-4cf1-a3db-4f99d933918e tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69853458afe04251bc794811e860e0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a1fc61e034b819f787a6c7412b855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:52.322581 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-9c1827a6-083a-4cf1-a3db-4f99d933918e tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] 10.222.0.79 "GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8" status: 200 len: 1470 microversion: 2.1 time: 1.203349 Apr 30 13:18:52.323170 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 125/298] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:51 2021] GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8 => generated 1470 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:52.328688 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-8d02b33d-9178-4dfa-a9c8-e753c6662844 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:52.330222 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-8d02b33d-9178-4dfa-a9c8-e753c6662844 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 93d74a82-eb0b-4b65-bbe2-8960312e9dd8] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:52.339051 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8d02b33d-9178-4dfa-a9c8-e753c6662844 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:52.339820 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8d02b33d-9178-4dfa-a9c8-e753c6662844 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:52.340729 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8d02b33d-9178-4dfa-a9c8-e753c6662844 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:52.341242 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8d02b33d-9178-4dfa-a9c8-e753c6662844 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:52.968686 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.virt.hardware [None req-b1f4b4e5-9670-4460-b1aa-34840d1e8e36 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Flavor limits 0:0:0 {{(pid=87933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 13:18:52.969348 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.virt.hardware [None req-b1f4b4e5-9670-4460-b1aa-34840d1e8e36 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Image limits 0:0:0 {{(pid=87933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 13:18:52.970056 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.virt.hardware [None req-b1f4b4e5-9670-4460-b1aa-34840d1e8e36 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Flavor pref 0:0:0 {{(pid=87933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 13:18:52.970556 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.virt.hardware [None req-b1f4b4e5-9670-4460-b1aa-34840d1e8e36 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Image pref 0:0:0 {{(pid=87933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 13:18:52.971488 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.virt.hardware [None req-b1f4b4e5-9670-4460-b1aa-34840d1e8e36 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 13:18:52.983395 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b1f4b4e5-9670-4460-b1aa-34840d1e8e36 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:52.984097 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b1f4b4e5-9670-4460-b1aa-34840d1e8e36 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:52.985165 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b1f4b4e5-9670-4460-b1aa-34840d1e8e36 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:52.985789 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b1f4b4e5-9670-4460-b1aa-34840d1e8e36 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:53.013426 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.quota [None req-b1f4b4e5-9670-4460-b1aa-34840d1e8e36 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Getting quotas for project 073a579db08449979c1fefb12078f6e9. Resources: {'ram', 'instances', 'cores'} {{(pid=87933) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:18:53.019287 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.quota [None req-b1f4b4e5-9670-4460-b1aa-34840d1e8e36 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Getting quotas for user 3e5f5b2ef3b243a5b503e95083c50449 and project 073a579db08449979c1fefb12078f6e9. Resources: {'ram', 'instances', 'cores'} {{(pid=87933) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:18:53.032790 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-b1f4b4e5-9670-4460-b1aa-34840d1e8e36 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Going to run 1 instances... {{(pid=87933) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 13:18:53.035086 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-b1f4b4e5-9670-4460-b1aa-34840d1e8e36 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: 8ae91590-af1f-473b-9391-f77fe37593f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='705a0c6b-b003-4687-84bf-8b9f87dae39e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=87933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 13:18:53.098593 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b1f4b4e5-9670-4460-b1aa-34840d1e8e36 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.108408 Apr 30 13:18:53.099501 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 174/299] 10.222.0.79 () {60 vars in 1147 bytes} [Fri Apr 30 13:18:51 2021] POST /compute/v2.1/servers => generated 380 bytes in 1118 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 13:18:53.107516 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-5ce8a36b-6acf-4399-8b6b-eb887e08e6d9 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:18:53.109997 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-5ce8a36b-6acf-4399-8b6b-eb887e08e6d9 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:53.152839 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-8d02b33d-9178-4dfa-a9c8-e753c6662844 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:53.168585 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-8d02b33d-9178-4dfa-a9c8-e753c6662844 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8" status: 200 len: 1318 microversion: 2.1 time: 0.837465 Apr 30 13:18:53.169258 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 126/300] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:52 2021] GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8 => generated 1318 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:53.174199 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5ce8a36b-6acf-4399-8b6b-eb887e08e6d9 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:53.175002 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5ce8a36b-6acf-4399-8b6b-eb887e08e6d9 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:53.176018 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5ce8a36b-6acf-4399-8b6b-eb887e08e6d9 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:53.176626 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5ce8a36b-6acf-4399-8b6b-eb887e08e6d9 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:53.183050 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-ec7610e4-cd22-4ca9-bcff-82bd6a6fd699 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:53.183668 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-ec7610e4-cd22-4ca9-bcff-82bd6a6fd699 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:53.201666 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ec7610e4-cd22-4ca9-bcff-82bd6a6fd699 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:53.202151 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ec7610e4-cd22-4ca9-bcff-82bd6a6fd699 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:53.202963 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ec7610e4-cd22-4ca9-bcff-82bd6a6fd699 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:53.203406 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ec7610e4-cd22-4ca9-bcff-82bd6a6fd699 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:53.482637 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-5ce8a36b-6acf-4399-8b6b-eb887e08e6d9 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action" status: 200 len: 38224 microversion: 2.20 time: 0.381294 Apr 30 13:18:53.484175 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 175/301] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:18:53 2021] POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action => generated 38224 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:18:53.491367 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-1cbff813-dc3a-4706-9ab5-8348fc254f25 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:53.494605 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-1cbff813-dc3a-4706-9ab5-8348fc254f25 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 2050955f-b5e4-4bfb-9d57-cc100dd9c25b] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:53.518843 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1cbff813-dc3a-4706-9ab5-8348fc254f25 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:53.519730 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1cbff813-dc3a-4706-9ab5-8348fc254f25 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:53.522266 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1cbff813-dc3a-4706-9ab5-8348fc254f25 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:53.523447 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1cbff813-dc3a-4706-9ab5-8348fc254f25 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:53.780726 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-ec7610e4-cd22-4ca9-bcff-82bd6a6fd699 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:53.799637 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-ec7610e4-cd22-4ca9-bcff-82bd6a6fd699 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1520 microversion: 2.1 time: 0.620161 Apr 30 13:18:53.800228 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 127/302] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:53 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1520 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:53.808142 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-99d67858-caaf-4ed2-ab6a-7b311ed267c2 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:53.809159 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-99d67858-caaf-4ed2-ab6a-7b311ed267c2 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: 8ae91590-af1f-473b-9391-f77fe37593f2] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:53.817773 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-99d67858-caaf-4ed2-ab6a-7b311ed267c2 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:53.818745 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-99d67858-caaf-4ed2-ab6a-7b311ed267c2 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:53.819792 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-99d67858-caaf-4ed2-ab6a-7b311ed267c2 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:53.820442 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-99d67858-caaf-4ed2-ab6a-7b311ed267c2 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:53.869352 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-1cbff813-dc3a-4706-9ab5-8348fc254f25 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc9375be240416da7db978d32bd5531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079985bd0cc444091cb61ab2418c9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:53.880233 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-1cbff813-dc3a-4706-9ab5-8348fc254f25 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] 10.222.0.79 "GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b" status: 200 len: 1314 microversion: 2.1 time: 0.394529 Apr 30 13:18:53.883287 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 176/303] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:53 2021] GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b => generated 1314 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:53.888771 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-f83b9005-0208-4a17-a942-c0b766257f36 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:53.889634 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-f83b9005-0208-4a17-a942-c0b766257f36 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] [instance: f55df369-be4b-420f-918b-ae65b6d8fea8] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:53.900313 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f83b9005-0208-4a17-a942-c0b766257f36 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:53.900959 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f83b9005-0208-4a17-a942-c0b766257f36 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:53.902272 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f83b9005-0208-4a17-a942-c0b766257f36 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:53.903105 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f83b9005-0208-4a17-a942-c0b766257f36 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:53.986725 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f83b9005-0208-4a17-a942-c0b766257f36 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:53.987358 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f83b9005-0208-4a17-a942-c0b766257f36 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:53.987621 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.objects.instance [None req-f83b9005-0208-4a17-a942-c0b766257f36 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lazy-loading 'fault' on Instance uuid f55df369-be4b-420f-918b-ae65b6d8fea8 {{(pid=87933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:18:53.989091 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-99d67858-caaf-4ed2-ab6a-7b311ed267c2 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:53.998814 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-99d67858-caaf-4ed2-ab6a-7b311ed267c2 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/8ae91590-af1f-473b-9391-f77fe37593f2" status: 200 len: 1223 microversion: 2.1 time: 0.197153 Apr 30 13:18:53.999661 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 128/304] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:53 2021] GET /compute/v2.1/servers/8ae91590-af1f-473b-9391-f77fe37593f2 => generated 1223 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:54.004389 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-a3cbfeea-f5a7-4f2a-9529-9e2465e36e14 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:54.004941 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-a3cbfeea-f5a7-4f2a-9529-9e2465e36e14 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:54.014151 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a3cbfeea-f5a7-4f2a-9529-9e2465e36e14 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:54.014611 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a3cbfeea-f5a7-4f2a-9529-9e2465e36e14 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:54.015404 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a3cbfeea-f5a7-4f2a-9529-9e2465e36e14 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:54.015845 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a3cbfeea-f5a7-4f2a-9529-9e2465e36e14 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:54.053866 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-f83b9005-0208-4a17-a942-c0b766257f36 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69853458afe04251bc794811e860e0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a1fc61e034b819f787a6c7412b855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:54.062959 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-f83b9005-0208-4a17-a942-c0b766257f36 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] 10.222.0.79 "GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8" status: 200 len: 1305 microversion: 2.1 time: 0.178385 Apr 30 13:18:54.065774 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 177/305] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:53 2021] GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8 => generated 1305 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:54.070148 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [req-f1188f9e-63ed-413e-9a87-9e562a51d6d2 req-dce16d07-4f23-4c6c-8280-6423ec078f16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f55df369-be4b-420f-918b-ae65b6d8fea8", "name": "network-vif-deleted", "tag": "666547ca-74f8-4ce0-8769-6f5f3b80978e"}]} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:18:54.072223 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:18:54.072223 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: warnings.warn(msg) Apr 30 13:18:54.080892 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-f1188f9e-63ed-413e-9a87-9e562a51d6d2 req-dce16d07-4f23-4c6c-8280-6423ec078f16 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:54.081159 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-a3cbfeea-f5a7-4f2a-9529-9e2465e36e14 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/ips" status: 200 len: 150 microversion: 2.20 time: 0.080145 Apr 30 13:18:54.081624 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-f1188f9e-63ed-413e-9a87-9e562a51d6d2 req-dce16d07-4f23-4c6c-8280-6423ec078f16 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:54.082141 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 129/306] 10.222.0.79 () {60 vars in 1289 bytes} [Fri Apr 30 13:18:53 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/ips => generated 150 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:18:54.103863 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.compute.server_external_events [req-f1188f9e-63ed-413e-9a87-9e562a51d6d2 req-dce16d07-4f23-4c6c-8280-6423ec078f16 service nova] Creating event network-vif-deleted:666547ca-74f8-4ce0-8769-6f5f3b80978e for instance f55df369-be4b-420f-918b-ae65b6d8fea8 on hv-cinder-78836 Apr 30 13:18:54.108364 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [req-f1188f9e-63ed-413e-9a87-9e562a51d6d2 req-dce16d07-4f23-4c6c-8280-6423ec078f16 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043551 Apr 30 13:18:54.109159 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 178/307] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:18:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:18:54.185269 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-56ccb9e3-f16c-4090-91c5-89520f6ea13b tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:54.185883 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-56ccb9e3-f16c-4090-91c5-89520f6ea13b tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 93d74a82-eb0b-4b65-bbe2-8960312e9dd8] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:54.194488 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-56ccb9e3-f16c-4090-91c5-89520f6ea13b tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:54.194928 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-56ccb9e3-f16c-4090-91c5-89520f6ea13b tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:54.195732 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-56ccb9e3-f16c-4090-91c5-89520f6ea13b tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:54.196156 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-56ccb9e3-f16c-4090-91c5-89520f6ea13b tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:54.422450 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-56ccb9e3-f16c-4090-91c5-89520f6ea13b tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:54.431617 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-56ccb9e3-f16c-4090-91c5-89520f6ea13b tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8" status: 200 len: 1318 microversion: 2.1 time: 0.249975 Apr 30 13:18:54.432414 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 130/308] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:54 2021] GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8 => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:54.818128 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-0cc2451f-1027-4bf1-8006-c3a663c50d7c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:54.819498 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-0cc2451f-1027-4bf1-8006-c3a663c50d7c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:54.827629 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0cc2451f-1027-4bf1-8006-c3a663c50d7c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:54.828318 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0cc2451f-1027-4bf1-8006-c3a663c50d7c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:54.829036 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0cc2451f-1027-4bf1-8006-c3a663c50d7c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:54.829469 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0cc2451f-1027-4bf1-8006-c3a663c50d7c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:54.900636 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-2e4df435-3881-4501-aba7-840994757674 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:54.901297 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-2e4df435-3881-4501-aba7-840994757674 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 2050955f-b5e4-4bfb-9d57-cc100dd9c25b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:54.931126 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2e4df435-3881-4501-aba7-840994757674 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:54.931587 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2e4df435-3881-4501-aba7-840994757674 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:54.932396 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2e4df435-3881-4501-aba7-840994757674 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:54.932833 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2e4df435-3881-4501-aba7-840994757674 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:55.055773 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-0cc2451f-1027-4bf1-8006-c3a663c50d7c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:55.064465 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-0cc2451f-1027-4bf1-8006-c3a663c50d7c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1520 microversion: 2.1 time: 0.251327 Apr 30 13:18:55.065375 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 179/309] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:54 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1520 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:18:55.072492 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-32c75320-c543-487e-aeca-aa9836af7197 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:55.073429 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-32c75320-c543-487e-aeca-aa9836af7197 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: 8ae91590-af1f-473b-9391-f77fe37593f2] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:55.083030 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-32c75320-c543-487e-aeca-aa9836af7197 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:55.083577 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-32c75320-c543-487e-aeca-aa9836af7197 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:55.085259 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-32c75320-c543-487e-aeca-aa9836af7197 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:55.085704 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-32c75320-c543-487e-aeca-aa9836af7197 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:55.155835 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-2e4df435-3881-4501-aba7-840994757674 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc9375be240416da7db978d32bd5531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079985bd0cc444091cb61ab2418c9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:55.165719 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-2e4df435-3881-4501-aba7-840994757674 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] 10.222.0.79 "GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b" status: 200 len: 1314 microversion: 2.1 time: 0.269882 Apr 30 13:18:55.170378 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 131/310] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:54 2021] GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:18:55.177240 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-4e88be9f-d369-42c4-817a-86cd0e320113 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:55.178929 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-4e88be9f-d369-42c4-817a-86cd0e320113 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] [instance: f55df369-be4b-420f-918b-ae65b6d8fea8] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:55.187086 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4e88be9f-d369-42c4-817a-86cd0e320113 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:55.187748 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4e88be9f-d369-42c4-817a-86cd0e320113 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:55.189032 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4e88be9f-d369-42c4-817a-86cd0e320113 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:55.190022 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4e88be9f-d369-42c4-817a-86cd0e320113 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:55.207547 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-32c75320-c543-487e-aeca-aa9836af7197 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:55.222501 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-32c75320-c543-487e-aeca-aa9836af7197 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/8ae91590-af1f-473b-9391-f77fe37593f2" status: 200 len: 1215 microversion: 2.1 time: 0.155712 Apr 30 13:18:55.223089 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 180/311] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:55 2021] GET /compute/v2.1/servers/8ae91590-af1f-473b-9391-f77fe37593f2 => generated 1215 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:55.275408 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4e88be9f-d369-42c4-817a-86cd0e320113 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:55.275856 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4e88be9f-d369-42c4-817a-86cd0e320113 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:55.276332 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.objects.instance [None req-4e88be9f-d369-42c4-817a-86cd0e320113 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lazy-loading 'fault' on Instance uuid f55df369-be4b-420f-918b-ae65b6d8fea8 {{(pid=87932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:18:55.357472 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-4e88be9f-d369-42c4-817a-86cd0e320113 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69853458afe04251bc794811e860e0f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723a1fc61e034b819f787a6c7412b855', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:55.367359 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-4e88be9f-d369-42c4-817a-86cd0e320113 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] 10.222.0.79 "GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8" status: 200 len: 1305 microversion: 2.1 time: 0.195377 Apr 30 13:18:55.368076 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 132/312] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:55 2021] GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8 => generated 1305 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:55.449561 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-ae2f9b5a-1fa7-4614-8dd8-0ace6e9444d2 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:55.450235 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-ae2f9b5a-1fa7-4614-8dd8-0ace6e9444d2 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 93d74a82-eb0b-4b65-bbe2-8960312e9dd8] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:55.458373 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ae2f9b5a-1fa7-4614-8dd8-0ace6e9444d2 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:55.459356 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ae2f9b5a-1fa7-4614-8dd8-0ace6e9444d2 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:55.460158 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ae2f9b5a-1fa7-4614-8dd8-0ace6e9444d2 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:55.460663 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ae2f9b5a-1fa7-4614-8dd8-0ace6e9444d2 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:55.670073 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-ae2f9b5a-1fa7-4614-8dd8-0ace6e9444d2 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:55.678613 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-ae2f9b5a-1fa7-4614-8dd8-0ace6e9444d2 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8" status: 200 len: 1318 microversion: 2.1 time: 0.233483 Apr 30 13:18:55.679191 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 181/313] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:55 2021] GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8 => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:56.089383 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-965314b2-56c1-4842-8b81-92c4d6d3457e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:56.092752 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-965314b2-56c1-4842-8b81-92c4d6d3457e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:56.117968 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-965314b2-56c1-4842-8b81-92c4d6d3457e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:56.118837 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-965314b2-56c1-4842-8b81-92c4d6d3457e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:56.120754 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-965314b2-56c1-4842-8b81-92c4d6d3457e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:56.121777 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-965314b2-56c1-4842-8b81-92c4d6d3457e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:56.185095 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-186d59c4-e5bf-49ce-8ccc-45151c175b86 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:56.185722 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-186d59c4-e5bf-49ce-8ccc-45151c175b86 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 2050955f-b5e4-4bfb-9d57-cc100dd9c25b] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:56.200266 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-186d59c4-e5bf-49ce-8ccc-45151c175b86 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:56.200593 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-186d59c4-e5bf-49ce-8ccc-45151c175b86 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:56.202085 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-186d59c4-e5bf-49ce-8ccc-45151c175b86 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:56.210060 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-186d59c4-e5bf-49ce-8ccc-45151c175b86 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:56.461061 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-186d59c4-e5bf-49ce-8ccc-45151c175b86 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc9375be240416da7db978d32bd5531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079985bd0cc444091cb61ab2418c9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:56.469504 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-186d59c4-e5bf-49ce-8ccc-45151c175b86 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] 10.222.0.79 "GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b" status: 200 len: 1314 microversion: 2.1 time: 0.288944 Apr 30 13:18:56.470096 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 182/314] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:56 2021] GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:18:56.494271 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-436b7766-6b6e-4aab-9816-4ffde24ab675 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:56.495022 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-436b7766-6b6e-4aab-9816-4ffde24ab675 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: 8ae91590-af1f-473b-9391-f77fe37593f2] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:56.506407 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-436b7766-6b6e-4aab-9816-4ffde24ab675 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:56.506407 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-436b7766-6b6e-4aab-9816-4ffde24ab675 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:56.507558 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-436b7766-6b6e-4aab-9816-4ffde24ab675 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:56.508048 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-436b7766-6b6e-4aab-9816-4ffde24ab675 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:56.548783 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-965314b2-56c1-4842-8b81-92c4d6d3457e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:56.559001 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-965314b2-56c1-4842-8b81-92c4d6d3457e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1520 microversion: 2.1 time: 0.478983 Apr 30 13:18:56.559892 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 133/315] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:56 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1520 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:56.565280 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-9f349044-9331-44c1-a383-701439731481 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:56.566161 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-9f349044-9331-44c1-a383-701439731481 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] [instance: f55df369-be4b-420f-918b-ae65b6d8fea8] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:56.575557 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9f349044-9331-44c1-a383-701439731481 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:56.576297 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9f349044-9331-44c1-a383-701439731481 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:56.577268 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9f349044-9331-44c1-a383-701439731481 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:56.577859 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9f349044-9331-44c1-a383-701439731481 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:56.656200 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.wsgi [None req-9f349044-9331-44c1-a383-701439731481 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] HTTP exception thrown: Instance f55df369-be4b-420f-918b-ae65b6d8fea8 could not be found. Apr 30 13:18:56.657225 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-9f349044-9331-44c1-a383-701439731481 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] Returning 404 to user: Instance f55df369-be4b-420f-918b-ae65b6d8fea8 could not be found. {{(pid=87932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:18:56.658618 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-9f349044-9331-44c1-a383-701439731481 tempest-VolumesNegativeTest-1896350164 tempest-VolumesNegativeTest-1896350164-project] 10.222.0.79 "GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8" status: 404 len: 111 microversion: 2.1 time: 0.097185 Apr 30 13:18:56.659305 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 134/316] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:56 2021] GET /compute/v2.1/servers/f55df369-be4b-420f-918b-ae65b6d8fea8 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:18:56.697849 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-39ac89fe-dd67-4561-91c8-36bfe07a3aaa tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:56.699067 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-39ac89fe-dd67-4561-91c8-36bfe07a3aaa tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 93d74a82-eb0b-4b65-bbe2-8960312e9dd8] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:56.708168 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-39ac89fe-dd67-4561-91c8-36bfe07a3aaa tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:56.709013 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-39ac89fe-dd67-4561-91c8-36bfe07a3aaa tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:56.710219 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-39ac89fe-dd67-4561-91c8-36bfe07a3aaa tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:56.710813 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-39ac89fe-dd67-4561-91c8-36bfe07a3aaa tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:56.718693 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-436b7766-6b6e-4aab-9816-4ffde24ab675 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:56.729212 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-436b7766-6b6e-4aab-9816-4ffde24ab675 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/8ae91590-af1f-473b-9391-f77fe37593f2" status: 200 len: 1277 microversion: 2.1 time: 0.244648 Apr 30 13:18:56.730276 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 183/317] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:56 2021] GET /compute/v2.1/servers/8ae91590-af1f-473b-9391-f77fe37593f2 => generated 1277 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:56.796410 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-a82c813c-6c7e-4222-994c-33e619e3771a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:18:56.797626 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-a82c813c-6c7e-4222-994c-33e619e3771a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:56.808338 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a82c813c-6c7e-4222-994c-33e619e3771a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:56.809125 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a82c813c-6c7e-4222-994c-33e619e3771a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:56.810879 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a82c813c-6c7e-4222-994c-33e619e3771a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:56.811925 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a82c813c-6c7e-4222-994c-33e619e3771a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:56.894240 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.objects.instance [None req-a82c813c-6c7e-4222-994c-33e619e3771a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lazy-loading 'flavor' on Instance uuid ad3419a7-71af-4a52-bcb7-6048e0553df9 {{(pid=87933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:18:57.107042 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-39ac89fe-dd67-4561-91c8-36bfe07a3aaa tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:57.118276 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-39ac89fe-dd67-4561-91c8-36bfe07a3aaa tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8" status: 200 len: 1318 microversion: 2.1 time: 0.426655 Apr 30 13:18:57.119407 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 135/318] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:56 2021] GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8 => generated 1318 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:18:57.488272 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-2da41c61-cc76-4bf9-92c1-d3672046b422 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:57.489087 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-2da41c61-cc76-4bf9-92c1-d3672046b422 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 2050955f-b5e4-4bfb-9d57-cc100dd9c25b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:57.499475 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2da41c61-cc76-4bf9-92c1-d3672046b422 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:57.500350 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2da41c61-cc76-4bf9-92c1-d3672046b422 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:57.501629 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2da41c61-cc76-4bf9-92c1-d3672046b422 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:57.502402 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2da41c61-cc76-4bf9-92c1-d3672046b422 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:57.861934 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-a82c813c-6c7e-4222-994c-33e619e3771a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action" status: 202 len: 0 microversion: 2.20 time: 1.068223 Apr 30 13:18:57.863267 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 184/319] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:18:56 2021] POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action => generated 0 bytes in 1071 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 30 13:18:57.880568 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-0f90e193-fc42-423d-8e9f-3e0d9e32e104 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:57.885757 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-0f90e193-fc42-423d-8e9f-3e0d9e32e104 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:57.902752 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0f90e193-fc42-423d-8e9f-3e0d9e32e104 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:57.906908 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0f90e193-fc42-423d-8e9f-3e0d9e32e104 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:57.916592 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0f90e193-fc42-423d-8e9f-3e0d9e32e104 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:57.917539 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0f90e193-fc42-423d-8e9f-3e0d9e32e104 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:58.078499 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-2da41c61-cc76-4bf9-92c1-d3672046b422 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc9375be240416da7db978d32bd5531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079985bd0cc444091cb61ab2418c9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:58.089999 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-2da41c61-cc76-4bf9-92c1-d3672046b422 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] 10.222.0.79 "GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b" status: 200 len: 1314 microversion: 2.1 time: 0.606574 Apr 30 13:18:58.091524 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 136/320] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:57 2021] GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b => generated 1314 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:58.096085 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-3e5179e9-3be5-4728-a8c1-854ae81831b4 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:58.097075 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-3e5179e9-3be5-4728-a8c1-854ae81831b4 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: 8ae91590-af1f-473b-9391-f77fe37593f2] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:58.106627 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3e5179e9-3be5-4728-a8c1-854ae81831b4 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:58.107527 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3e5179e9-3be5-4728-a8c1-854ae81831b4 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:58.109821 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3e5179e9-3be5-4728-a8c1-854ae81831b4 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:58.110774 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3e5179e9-3be5-4728-a8c1-854ae81831b4 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:58.196144 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-0f90e193-fc42-423d-8e9f-3e0d9e32e104 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:58.210537 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-0f90e193-fc42-423d-8e9f-3e0d9e32e104 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1520 microversion: 2.1 time: 0.342589 Apr 30 13:18:58.211210 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 185/321] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:57 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1520 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:58.226098 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-31cc9a81-8a14-4743-81c7-c4a8a86e9d51 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:58.226766 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-31cc9a81-8a14-4743-81c7-c4a8a86e9d51 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:58.235238 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-31cc9a81-8a14-4743-81c7-c4a8a86e9d51 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:58.235699 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-31cc9a81-8a14-4743-81c7-c4a8a86e9d51 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:58.236496 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-31cc9a81-8a14-4743-81c7-c4a8a86e9d51 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:58.236935 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-31cc9a81-8a14-4743-81c7-c4a8a86e9d51 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:58.657939 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-31cc9a81-8a14-4743-81c7-c4a8a86e9d51 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:58.673114 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-31cc9a81-8a14-4743-81c7-c4a8a86e9d51 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:58.675744 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-31cc9a81-8a14-4743-81c7-c4a8a86e9d51 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:58.679489 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-31cc9a81-8a14-4743-81c7-c4a8a86e9d51 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1721 microversion: 2.20 time: 0.458065 Apr 30 13:18:58.690856 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 186/322] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:18:58 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1721 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:18:58.705913 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-107dc234-0cc9-430f-975f-102dedd5a128 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:58.707015 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-107dc234-0cc9-430f-975f-102dedd5a128 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 93d74a82-eb0b-4b65-bbe2-8960312e9dd8] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:58.718347 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-107dc234-0cc9-430f-975f-102dedd5a128 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:58.718994 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-107dc234-0cc9-430f-975f-102dedd5a128 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:58.719953 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-107dc234-0cc9-430f-975f-102dedd5a128 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:58.720574 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-107dc234-0cc9-430f-975f-102dedd5a128 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:58.902096 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-3e5179e9-3be5-4728-a8c1-854ae81831b4 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:58.918904 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-3e5179e9-3be5-4728-a8c1-854ae81831b4 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/8ae91590-af1f-473b-9391-f77fe37593f2" status: 200 len: 1319 microversion: 2.1 time: 0.825785 Apr 30 13:18:58.921707 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 137/323] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:58 2021] GET /compute/v2.1/servers/8ae91590-af1f-473b-9391-f77fe37593f2 => generated 1319 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:59.005186 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [req-fabcbad7-3e0f-4bc6-b101-1a684417d001 req-3a1e78df-b0ab-418c-9fdc-84a600507162 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ae91590-af1f-473b-9391-f77fe37593f2", "tag": "25347b02-eba4-4cb1-8902-90ae885f45d1"}]} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:18:59.008345 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:18:59.008345 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: warnings.warn(msg) Apr 30 13:18:59.024766 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-fabcbad7-3e0f-4bc6-b101-1a684417d001 req-3a1e78df-b0ab-418c-9fdc-84a600507162 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:59.025763 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-fabcbad7-3e0f-4bc6-b101-1a684417d001 req-3a1e78df-b0ab-418c-9fdc-84a600507162 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:59.028337 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-107dc234-0cc9-430f-975f-102dedd5a128 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:59.038244 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-107dc234-0cc9-430f-975f-102dedd5a128 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8" status: 200 len: 1318 microversion: 2.1 time: 0.336590 Apr 30 13:18:59.038841 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 187/324] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:58 2021] GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8 => generated 1318 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:59.050285 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.compute.server_external_events [req-fabcbad7-3e0f-4bc6-b101-1a684417d001 req-3a1e78df-b0ab-418c-9fdc-84a600507162 service nova] Creating event network-changed:25347b02-eba4-4cb1-8902-90ae885f45d1 for instance 8ae91590-af1f-473b-9391-f77fe37593f2 on hv-cinder-78836 Apr 30 13:18:59.056533 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [req-fabcbad7-3e0f-4bc6-b101-1a684417d001 req-3a1e78df-b0ab-418c-9fdc-84a600507162 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056220 Apr 30 13:18:59.057962 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 138/325] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:18:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:18:59.107238 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-4a1e7244-902a-4fc2-984a-28dc6281a9f8 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:59.107971 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-4a1e7244-902a-4fc2-984a-28dc6281a9f8 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 2050955f-b5e4-4bfb-9d57-cc100dd9c25b] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:59.116687 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4a1e7244-902a-4fc2-984a-28dc6281a9f8 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:59.117503 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4a1e7244-902a-4fc2-984a-28dc6281a9f8 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:59.118430 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4a1e7244-902a-4fc2-984a-28dc6281a9f8 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:59.118940 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4a1e7244-902a-4fc2-984a-28dc6281a9f8 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:59.234931 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-2f538098-5f1f-481e-8a5c-7ce02bd8296f tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:59.236782 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-2f538098-5f1f-481e-8a5c-7ce02bd8296f tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:59.250694 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2f538098-5f1f-481e-8a5c-7ce02bd8296f tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:59.251108 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2f538098-5f1f-481e-8a5c-7ce02bd8296f tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:59.251889 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2f538098-5f1f-481e-8a5c-7ce02bd8296f tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:59.252334 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2f538098-5f1f-481e-8a5c-7ce02bd8296f tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:59.352022 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-4a1e7244-902a-4fc2-984a-28dc6281a9f8 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc9375be240416da7db978d32bd5531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079985bd0cc444091cb61ab2418c9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:59.363349 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-4a1e7244-902a-4fc2-984a-28dc6281a9f8 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] 10.222.0.79 "GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b" status: 200 len: 1314 microversion: 2.1 time: 0.259324 Apr 30 13:18:59.366053 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 188/326] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:59 2021] GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:18:59.596209 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-2f538098-5f1f-481e-8a5c-7ce02bd8296f tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:59.621712 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-2f538098-5f1f-481e-8a5c-7ce02bd8296f tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1520 microversion: 2.1 time: 0.397760 Apr 30 13:18:59.624162 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 139/327] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:59 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1520 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:18:59.699951 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-7f3e7273-0ffb-4341-a73c-244382da3b8d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:59.700571 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-7f3e7273-0ffb-4341-a73c-244382da3b8d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:59.709899 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7f3e7273-0ffb-4341-a73c-244382da3b8d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:59.710686 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7f3e7273-0ffb-4341-a73c-244382da3b8d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:59.719599 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7f3e7273-0ffb-4341-a73c-244382da3b8d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:59.720065 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7f3e7273-0ffb-4341-a73c-244382da3b8d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:59.937117 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-cdf26cc1-b6a3-4ea6-9561-6ab7fe40a691 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:18:59.938122 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-cdf26cc1-b6a3-4ea6-9561-6ab7fe40a691 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: 8ae91590-af1f-473b-9391-f77fe37593f2] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:18:59.947100 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cdf26cc1-b6a3-4ea6-9561-6ab7fe40a691 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:59.947907 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cdf26cc1-b6a3-4ea6-9561-6ab7fe40a691 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:59.949348 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cdf26cc1-b6a3-4ea6-9561-6ab7fe40a691 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:18:59.950025 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cdf26cc1-b6a3-4ea6-9561-6ab7fe40a691 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:18:59.977146 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-7f3e7273-0ffb-4341-a73c-244382da3b8d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:59.993824 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-7f3e7273-0ffb-4341-a73c-244382da3b8d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:59.996184 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-7f3e7273-0ffb-4341-a73c-244382da3b8d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:18:59.997594 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-7f3e7273-0ffb-4341-a73c-244382da3b8d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1721 microversion: 2.20 time: 0.301478 Apr 30 13:18:59.998667 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 189/328] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:18:59 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1721 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:19:00.054926 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b1305119-40bf-4714-b73a-ee2bf86a059a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:00.055572 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-b1305119-40bf-4714-b73a-ee2bf86a059a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 93d74a82-eb0b-4b65-bbe2-8960312e9dd8] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:00.070800 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b1305119-40bf-4714-b73a-ee2bf86a059a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:00.071256 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b1305119-40bf-4714-b73a-ee2bf86a059a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:00.072239 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b1305119-40bf-4714-b73a-ee2bf86a059a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:00.072862 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b1305119-40bf-4714-b73a-ee2bf86a059a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:00.311616 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-b1305119-40bf-4714-b73a-ee2bf86a059a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:00.319183 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b1305119-40bf-4714-b73a-ee2bf86a059a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8" status: 200 len: 1318 microversion: 2.1 time: 0.267436 Apr 30 13:19:00.320905 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 190/329] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:00 2021] GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8 => generated 1318 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:19:00.355845 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-cdf26cc1-b6a3-4ea6-9561-6ab7fe40a691 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:00.365531 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-cdf26cc1-b6a3-4ea6-9561-6ab7fe40a691 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/8ae91590-af1f-473b-9391-f77fe37593f2" status: 200 len: 1319 microversion: 2.1 time: 0.432246 Apr 30 13:19:00.368937 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 140/330] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:18:59 2021] GET /compute/v2.1/servers/8ae91590-af1f-473b-9391-f77fe37593f2 => generated 1319 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:19:00.381791 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-bc89014a-a0a2-4b7e-bd71-9cadd647223e tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:00.382463 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-bc89014a-a0a2-4b7e-bd71-9cadd647223e tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 2050955f-b5e4-4bfb-9d57-cc100dd9c25b] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:00.390704 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-bc89014a-a0a2-4b7e-bd71-9cadd647223e tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:00.391166 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-bc89014a-a0a2-4b7e-bd71-9cadd647223e tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:00.392012 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-bc89014a-a0a2-4b7e-bd71-9cadd647223e tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:00.392542 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-bc89014a-a0a2-4b7e-bd71-9cadd647223e tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:00.644846 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-d644ae29-2975-4640-8579-b93b032cadc3 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:00.646108 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-d644ae29-2975-4640-8579-b93b032cadc3 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:00.662433 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d644ae29-2975-4640-8579-b93b032cadc3 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:00.663451 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d644ae29-2975-4640-8579-b93b032cadc3 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:00.664438 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d644ae29-2975-4640-8579-b93b032cadc3 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:00.665774 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d644ae29-2975-4640-8579-b93b032cadc3 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:00.709648 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-bc89014a-a0a2-4b7e-bd71-9cadd647223e tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc9375be240416da7db978d32bd5531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079985bd0cc444091cb61ab2418c9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:00.720610 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-bc89014a-a0a2-4b7e-bd71-9cadd647223e tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] 10.222.0.79 "GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b" status: 200 len: 1314 microversion: 2.1 time: 0.342932 Apr 30 13:19:00.721646 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 191/331] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:00 2021] GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:00.966869 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-d644ae29-2975-4640-8579-b93b032cadc3 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:00.977957 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-d644ae29-2975-4640-8579-b93b032cadc3 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1520 microversion: 2.1 time: 0.339238 Apr 30 13:19:00.983538 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 141/332] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:00 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1520 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:19:01.018577 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-345089e8-7546-4f0b-a385-c8c5f1f970bb tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:01.019190 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-345089e8-7546-4f0b-a385-c8c5f1f970bb tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:01.028438 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-345089e8-7546-4f0b-a385-c8c5f1f970bb tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:01.028888 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-345089e8-7546-4f0b-a385-c8c5f1f970bb tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:01.029690 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-345089e8-7546-4f0b-a385-c8c5f1f970bb tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:01.030196 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-345089e8-7546-4f0b-a385-c8c5f1f970bb tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:01.261810 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-345089e8-7546-4f0b-a385-c8c5f1f970bb tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:01.271223 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-345089e8-7546-4f0b-a385-c8c5f1f970bb tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:01.272925 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-345089e8-7546-4f0b-a385-c8c5f1f970bb tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:01.274117 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-345089e8-7546-4f0b-a385-c8c5f1f970bb tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1721 microversion: 2.20 time: 0.260137 Apr 30 13:19:01.274679 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 192/333] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:19:01 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1721 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:19:01.340050 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-c0a7244a-e12a-40dc-9f2e-da560f3d3558 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:01.343539 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-c0a7244a-e12a-40dc-9f2e-da560f3d3558 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 93d74a82-eb0b-4b65-bbe2-8960312e9dd8] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:01.355882 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c0a7244a-e12a-40dc-9f2e-da560f3d3558 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:01.356656 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c0a7244a-e12a-40dc-9f2e-da560f3d3558 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:01.358144 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c0a7244a-e12a-40dc-9f2e-da560f3d3558 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:01.359055 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c0a7244a-e12a-40dc-9f2e-da560f3d3558 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:01.384801 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-5e112224-a3e3-4ca3-aa0d-cb9de64dd7e0 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:01.385706 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-5e112224-a3e3-4ca3-aa0d-cb9de64dd7e0 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: 8ae91590-af1f-473b-9391-f77fe37593f2] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:01.393288 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5e112224-a3e3-4ca3-aa0d-cb9de64dd7e0 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:01.393745 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5e112224-a3e3-4ca3-aa0d-cb9de64dd7e0 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:01.394581 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5e112224-a3e3-4ca3-aa0d-cb9de64dd7e0 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:01.395050 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5e112224-a3e3-4ca3-aa0d-cb9de64dd7e0 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:01.620539 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-c0a7244a-e12a-40dc-9f2e-da560f3d3558 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:01.629231 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-5e112224-a3e3-4ca3-aa0d-cb9de64dd7e0 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:01.629382 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-c0a7244a-e12a-40dc-9f2e-da560f3d3558 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8" status: 200 len: 1318 microversion: 2.1 time: 0.295920 Apr 30 13:19:01.629935 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 142/334] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:01 2021] GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8 => generated 1318 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:01.638237 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-5e112224-a3e3-4ca3-aa0d-cb9de64dd7e0 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/8ae91590-af1f-473b-9391-f77fe37593f2" status: 200 len: 1319 microversion: 2.1 time: 0.258109 Apr 30 13:19:01.638818 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 193/335] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:01 2021] GET /compute/v2.1/servers/8ae91590-af1f-473b-9391-f77fe37593f2 => generated 1319 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:19:01.738474 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-4d80edd6-a513-4560-92a7-b62854f8be17 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:01.739095 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-4d80edd6-a513-4560-92a7-b62854f8be17 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 2050955f-b5e4-4bfb-9d57-cc100dd9c25b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:01.747405 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4d80edd6-a513-4560-92a7-b62854f8be17 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:01.747859 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4d80edd6-a513-4560-92a7-b62854f8be17 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:01.748643 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4d80edd6-a513-4560-92a7-b62854f8be17 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:01.749077 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4d80edd6-a513-4560-92a7-b62854f8be17 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:01.946909 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-4d80edd6-a513-4560-92a7-b62854f8be17 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc9375be240416da7db978d32bd5531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079985bd0cc444091cb61ab2418c9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:01.955279 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-4d80edd6-a513-4560-92a7-b62854f8be17 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] 10.222.0.79 "GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b" status: 200 len: 1314 microversion: 2.1 time: 0.220585 Apr 30 13:19:01.955849 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 143/336] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:01 2021] GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:01.995428 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-f463286f-2d8c-4033-9d27-e15c06931af1 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:01.996182 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-f463286f-2d8c-4033-9d27-e15c06931af1 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:02.003637 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f463286f-2d8c-4033-9d27-e15c06931af1 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:02.004088 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f463286f-2d8c-4033-9d27-e15c06931af1 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:02.004883 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f463286f-2d8c-4033-9d27-e15c06931af1 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:02.005324 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f463286f-2d8c-4033-9d27-e15c06931af1 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:02.221422 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-f463286f-2d8c-4033-9d27-e15c06931af1 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:02.232342 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-f463286f-2d8c-4033-9d27-e15c06931af1 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1520 microversion: 2.1 time: 0.240577 Apr 30 13:19:02.233383 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 194/337] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:01 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1520 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:02.293712 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-73acedeb-7e8f-4a6b-9fb2-4e0810ca7a31 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:02.294585 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-73acedeb-7e8f-4a6b-9fb2-4e0810ca7a31 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:02.302280 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-73acedeb-7e8f-4a6b-9fb2-4e0810ca7a31 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:02.302971 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-73acedeb-7e8f-4a6b-9fb2-4e0810ca7a31 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:02.303965 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-73acedeb-7e8f-4a6b-9fb2-4e0810ca7a31 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:02.304658 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-73acedeb-7e8f-4a6b-9fb2-4e0810ca7a31 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:02.408059 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [req-9459591f-1e82-409a-8e9d-f0085e8c68ae req-6d8436c3-c97a-49f4-a73d-12a6cd1eca4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2050955f-b5e4-4bfb-9d57-cc100dd9c25b", "name": "network-vif-plugged", "status": "completed", "tag": "6bf679fb-169f-4d67-b161-f2a15b38dde6"}]} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:19:02.409833 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:19:02.409833 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: warnings.warn(msg) Apr 30 13:19:02.419004 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-9459591f-1e82-409a-8e9d-f0085e8c68ae req-6d8436c3-c97a-49f4-a73d-12a6cd1eca4b service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:02.419459 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-9459591f-1e82-409a-8e9d-f0085e8c68ae req-6d8436c3-c97a-49f4-a73d-12a6cd1eca4b service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:02.436601 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.compute.server_external_events [req-9459591f-1e82-409a-8e9d-f0085e8c68ae req-6d8436c3-c97a-49f4-a73d-12a6cd1eca4b service nova] Creating event network-vif-plugged:6bf679fb-169f-4d67-b161-f2a15b38dde6 for instance 2050955f-b5e4-4bfb-9d57-cc100dd9c25b on hv-cinder-78836 Apr 30 13:19:02.443655 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [req-9459591f-1e82-409a-8e9d-f0085e8c68ae req-6d8436c3-c97a-49f4-a73d-12a6cd1eca4b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040298 Apr 30 13:19:02.444757 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 195/338] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:19:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:19:02.524384 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-73acedeb-7e8f-4a6b-9fb2-4e0810ca7a31 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:02.546448 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-73acedeb-7e8f-4a6b-9fb2-4e0810ca7a31 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:02.549534 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-73acedeb-7e8f-4a6b-9fb2-4e0810ca7a31 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:02.551790 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-73acedeb-7e8f-4a6b-9fb2-4e0810ca7a31 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1721 microversion: 2.20 time: 0.261981 Apr 30 13:19:02.552833 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 144/339] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:19:02 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1721 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:19:02.646979 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-e172586c-006e-49e3-b005-87f8bba74e7c tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:02.647980 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-e172586c-006e-49e3-b005-87f8bba74e7c tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 93d74a82-eb0b-4b65-bbe2-8960312e9dd8] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:02.655964 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-637011c1-dba6-481c-8c65-977b9bb371cd tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:02.656705 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-637011c1-dba6-481c-8c65-977b9bb371cd tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: 8ae91590-af1f-473b-9391-f77fe37593f2] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:02.658768 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e172586c-006e-49e3-b005-87f8bba74e7c tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:02.659193 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e172586c-006e-49e3-b005-87f8bba74e7c tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:02.660013 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e172586c-006e-49e3-b005-87f8bba74e7c tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:02.660455 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e172586c-006e-49e3-b005-87f8bba74e7c tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:02.665454 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-637011c1-dba6-481c-8c65-977b9bb371cd tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:02.666125 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-637011c1-dba6-481c-8c65-977b9bb371cd tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:02.667094 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-637011c1-dba6-481c-8c65-977b9bb371cd tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:02.667628 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-637011c1-dba6-481c-8c65-977b9bb371cd tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:02.898772 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-637011c1-dba6-481c-8c65-977b9bb371cd tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:02.899451 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-e172586c-006e-49e3-b005-87f8bba74e7c tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:02.909359 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-e172586c-006e-49e3-b005-87f8bba74e7c tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8" status: 200 len: 1318 microversion: 2.1 time: 0.266425 Apr 30 13:19:02.909964 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 196/340] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:02 2021] GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8 => generated 1318 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:02.911554 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-637011c1-dba6-481c-8c65-977b9bb371cd tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/8ae91590-af1f-473b-9391-f77fe37593f2" status: 200 len: 1319 microversion: 2.1 time: 0.259675 Apr 30 13:19:02.924197 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 145/341] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:02 2021] GET /compute/v2.1/servers/8ae91590-af1f-473b-9391-f77fe37593f2 => generated 1319 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:19:02.975705 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-127900a8-5e18-4f14-9b22-d3019420d332 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:02.976586 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-127900a8-5e18-4f14-9b22-d3019420d332 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 2050955f-b5e4-4bfb-9d57-cc100dd9c25b] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:02.988935 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-127900a8-5e18-4f14-9b22-d3019420d332 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:02.989658 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-127900a8-5e18-4f14-9b22-d3019420d332 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:02.991822 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-127900a8-5e18-4f14-9b22-d3019420d332 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:02.992599 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-127900a8-5e18-4f14-9b22-d3019420d332 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:03.252068 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-e2da76ed-0821-472e-915b-5c62a15576ed tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:03.253789 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-e2da76ed-0821-472e-915b-5c62a15576ed tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:03.261709 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e2da76ed-0821-472e-915b-5c62a15576ed tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:03.262320 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e2da76ed-0821-472e-915b-5c62a15576ed tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:03.262997 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e2da76ed-0821-472e-915b-5c62a15576ed tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:03.263434 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e2da76ed-0821-472e-915b-5c62a15576ed tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:03.266377 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-127900a8-5e18-4f14-9b22-d3019420d332 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc9375be240416da7db978d32bd5531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079985bd0cc444091cb61ab2418c9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:03.277412 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-127900a8-5e18-4f14-9b22-d3019420d332 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] 10.222.0.79 "GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b" status: 200 len: 1314 microversion: 2.1 time: 0.307671 Apr 30 13:19:03.278781 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 197/342] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:02 2021] GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:03.571758 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-9b13d3e2-d0d7-47d5-a809-18a965cad5f8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:03.573230 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-9b13d3e2-d0d7-47d5-a809-18a965cad5f8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:03.581000 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9b13d3e2-d0d7-47d5-a809-18a965cad5f8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:03.581544 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9b13d3e2-d0d7-47d5-a809-18a965cad5f8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:03.582755 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9b13d3e2-d0d7-47d5-a809-18a965cad5f8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:03.583204 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9b13d3e2-d0d7-47d5-a809-18a965cad5f8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:03.830742 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-9b13d3e2-d0d7-47d5-a809-18a965cad5f8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:03.840872 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-e2da76ed-0821-472e-915b-5c62a15576ed tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:03.845452 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-9b13d3e2-d0d7-47d5-a809-18a965cad5f8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:03.848329 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-9b13d3e2-d0d7-47d5-a809-18a965cad5f8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:03.850659 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-9b13d3e2-d0d7-47d5-a809-18a965cad5f8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1721 microversion: 2.20 time: 0.282458 Apr 30 13:19:03.862638 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-e2da76ed-0821-472e-915b-5c62a15576ed tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1520 microversion: 2.1 time: 0.612060 Apr 30 13:19:03.862638 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 146/343] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:03 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1520 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:19:03.863544 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 198/344] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:19:03 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1721 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:19:03.931832 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-37ec4109-dab5-4683-8604-3080e89328b5 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:03.932455 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-37ec4109-dab5-4683-8604-3080e89328b5 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: 8ae91590-af1f-473b-9391-f77fe37593f2] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:03.938583 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-a287d65b-a3de-47c9-a742-13a6da64ad7c tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:03.939195 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-a287d65b-a3de-47c9-a742-13a6da64ad7c tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 93d74a82-eb0b-4b65-bbe2-8960312e9dd8] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:03.940491 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-37ec4109-dab5-4683-8604-3080e89328b5 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:03.940960 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-37ec4109-dab5-4683-8604-3080e89328b5 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:03.941759 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-37ec4109-dab5-4683-8604-3080e89328b5 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:03.942248 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-37ec4109-dab5-4683-8604-3080e89328b5 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:03.947322 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a287d65b-a3de-47c9-a742-13a6da64ad7c tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:03.947803 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a287d65b-a3de-47c9-a742-13a6da64ad7c tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:03.948589 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a287d65b-a3de-47c9-a742-13a6da64ad7c tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:03.949031 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a287d65b-a3de-47c9-a742-13a6da64ad7c tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:04.162539 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-37ec4109-dab5-4683-8604-3080e89328b5 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:04.167469 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-a287d65b-a3de-47c9-a742-13a6da64ad7c tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:04.172127 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-37ec4109-dab5-4683-8604-3080e89328b5 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/8ae91590-af1f-473b-9391-f77fe37593f2" status: 200 len: 1319 microversion: 2.1 time: 0.244346 Apr 30 13:19:04.176720 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 147/345] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:03 2021] GET /compute/v2.1/servers/8ae91590-af1f-473b-9391-f77fe37593f2 => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:04.180384 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-a287d65b-a3de-47c9-a742-13a6da64ad7c tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8" status: 200 len: 1318 microversion: 2.1 time: 0.245584 Apr 30 13:19:04.181115 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 199/346] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:03 2021] GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8 => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:19:04.298863 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-58397d20-868c-4c3d-ab5a-f0d22be7238d tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:04.299636 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-58397d20-868c-4c3d-ab5a-f0d22be7238d tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 2050955f-b5e4-4bfb-9d57-cc100dd9c25b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:04.312227 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-58397d20-868c-4c3d-ab5a-f0d22be7238d tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:04.312971 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-58397d20-868c-4c3d-ab5a-f0d22be7238d tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:04.314301 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-58397d20-868c-4c3d-ab5a-f0d22be7238d tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:04.315036 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-58397d20-868c-4c3d-ab5a-f0d22be7238d tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:04.468954 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [req-9101fb24-df61-4b56-adbe-b37dc217bac5 req-779101ff-d5fd-474f-b5b7-a812ceabd39d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93d74a82-eb0b-4b65-bbe2-8960312e9dd8", "name": "network-vif-plugged", "status": "completed", "tag": "993e83a7-97b0-4089-ba75-29f8911a36c4"}]} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:19:04.472037 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:19:04.472037 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: warnings.warn(msg) Apr 30 13:19:04.481957 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-9101fb24-df61-4b56-adbe-b37dc217bac5 req-779101ff-d5fd-474f-b5b7-a812ceabd39d service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:04.483280 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-9101fb24-df61-4b56-adbe-b37dc217bac5 req-779101ff-d5fd-474f-b5b7-a812ceabd39d service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:04.505044 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.compute.server_external_events [req-9101fb24-df61-4b56-adbe-b37dc217bac5 req-779101ff-d5fd-474f-b5b7-a812ceabd39d service nova] Creating event network-vif-plugged:993e83a7-97b0-4089-ba75-29f8911a36c4 for instance 93d74a82-eb0b-4b65-bbe2-8960312e9dd8 on hv-cinder-78836 Apr 30 13:19:04.512174 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [req-9101fb24-df61-4b56-adbe-b37dc217bac5 req-779101ff-d5fd-474f-b5b7-a812ceabd39d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047831 Apr 30 13:19:04.513379 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 200/347] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:19:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:19:04.576501 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-58397d20-868c-4c3d-ab5a-f0d22be7238d tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc9375be240416da7db978d32bd5531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079985bd0cc444091cb61ab2418c9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:04.585532 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-58397d20-868c-4c3d-ab5a-f0d22be7238d tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] 10.222.0.79 "GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b" status: 200 len: 1314 microversion: 2.1 time: 0.293298 Apr 30 13:19:04.586054 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 148/348] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:04 2021] GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:04.875444 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-5d784d7a-60e3-4d65-851f-4898d2565799 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:04.876076 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-788bffb3-2345-4ef9-bafc-e2b90da4336e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:04.876417 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-5d784d7a-60e3-4d65-851f-4898d2565799 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:04.876493 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-788bffb3-2345-4ef9-bafc-e2b90da4336e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:04.886566 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-788bffb3-2345-4ef9-bafc-e2b90da4336e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:04.887814 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-788bffb3-2345-4ef9-bafc-e2b90da4336e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:04.889525 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-788bffb3-2345-4ef9-bafc-e2b90da4336e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:04.890557 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-788bffb3-2345-4ef9-bafc-e2b90da4336e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:04.894132 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5d784d7a-60e3-4d65-851f-4898d2565799 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:04.894566 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5d784d7a-60e3-4d65-851f-4898d2565799 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:04.895373 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5d784d7a-60e3-4d65-851f-4898d2565799 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:04.895810 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5d784d7a-60e3-4d65-851f-4898d2565799 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:05.151659 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-788bffb3-2345-4ef9-bafc-e2b90da4336e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:05.153405 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-5d784d7a-60e3-4d65-851f-4898d2565799 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:05.164743 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-5d784d7a-60e3-4d65-851f-4898d2565799 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1520 microversion: 2.1 time: 0.292736 Apr 30 13:19:05.165650 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 149/349] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:04 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1520 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:05.165898 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-788bffb3-2345-4ef9-bafc-e2b90da4336e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:05.167867 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-788bffb3-2345-4ef9-bafc-e2b90da4336e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:05.169481 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-788bffb3-2345-4ef9-bafc-e2b90da4336e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1721 microversion: 2.20 time: 0.301690 Apr 30 13:19:05.170065 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 201/350] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:19:04 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1721 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:19:05.189403 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-f7e38bfc-c310-4780-8a81-0f57a13f7879 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:05.190057 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-f7e38bfc-c310-4780-8a81-0f57a13f7879 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: 8ae91590-af1f-473b-9391-f77fe37593f2] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:05.197771 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-58cc0cd9-223f-418f-a709-4d94ebc0debc tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:05.198583 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-58cc0cd9-223f-418f-a709-4d94ebc0debc tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 93d74a82-eb0b-4b65-bbe2-8960312e9dd8] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:05.199520 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f7e38bfc-c310-4780-8a81-0f57a13f7879 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:05.199997 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f7e38bfc-c310-4780-8a81-0f57a13f7879 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:05.201200 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f7e38bfc-c310-4780-8a81-0f57a13f7879 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:05.201814 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f7e38bfc-c310-4780-8a81-0f57a13f7879 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:05.217201 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-58cc0cd9-223f-418f-a709-4d94ebc0debc tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:05.217674 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-58cc0cd9-223f-418f-a709-4d94ebc0debc tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:05.218571 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-58cc0cd9-223f-418f-a709-4d94ebc0debc tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:05.219023 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-58cc0cd9-223f-418f-a709-4d94ebc0debc tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:05.481196 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-58cc0cd9-223f-418f-a709-4d94ebc0debc tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:05.489817 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-58cc0cd9-223f-418f-a709-4d94ebc0debc tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8" status: 200 len: 1318 microversion: 2.1 time: 0.296875 Apr 30 13:19:05.490668 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 202/351] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:05 2021] GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8 => generated 1318 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:19:05.565786 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-f7e38bfc-c310-4780-8a81-0f57a13f7879 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:05.576954 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-f7e38bfc-c310-4780-8a81-0f57a13f7879 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/8ae91590-af1f-473b-9391-f77fe37593f2" status: 200 len: 1319 microversion: 2.1 time: 0.391582 Apr 30 13:19:05.577613 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 150/352] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:05 2021] GET /compute/v2.1/servers/8ae91590-af1f-473b-9391-f77fe37593f2 => generated 1319 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:05.603204 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-7623a496-872e-4184-833a-891842760ede tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:05.604165 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-7623a496-872e-4184-833a-891842760ede tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 2050955f-b5e4-4bfb-9d57-cc100dd9c25b] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:05.613778 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7623a496-872e-4184-833a-891842760ede tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:05.614395 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7623a496-872e-4184-833a-891842760ede tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:05.615387 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7623a496-872e-4184-833a-891842760ede tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:05.615916 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7623a496-872e-4184-833a-891842760ede tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:05.977018 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-7623a496-872e-4184-833a-891842760ede tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc9375be240416da7db978d32bd5531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079985bd0cc444091cb61ab2418c9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:05.993958 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-7623a496-872e-4184-833a-891842760ede tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] 10.222.0.79 "GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b" status: 200 len: 1314 microversion: 2.1 time: 0.395514 Apr 30 13:19:06.002966 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 203/353] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:05 2021] GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b => generated 1314 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:06.181764 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-ab819ddb-3ee3-45a6-ad43-80e418d60b9f tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:06.184246 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-ab819ddb-3ee3-45a6-ad43-80e418d60b9f tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:06.188818 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-5ef9e065-7ee3-4096-9047-22b7d15235f0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:06.189689 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-5ef9e065-7ee3-4096-9047-22b7d15235f0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:06.208030 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5ef9e065-7ee3-4096-9047-22b7d15235f0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:06.208030 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5ef9e065-7ee3-4096-9047-22b7d15235f0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:06.208030 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5ef9e065-7ee3-4096-9047-22b7d15235f0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:06.208030 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5ef9e065-7ee3-4096-9047-22b7d15235f0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:06.208375 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ab819ddb-3ee3-45a6-ad43-80e418d60b9f tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:06.208375 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ab819ddb-3ee3-45a6-ad43-80e418d60b9f tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:06.208375 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ab819ddb-3ee3-45a6-ad43-80e418d60b9f tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:06.208375 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ab819ddb-3ee3-45a6-ad43-80e418d60b9f tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:06.429292 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-5ef9e065-7ee3-4096-9047-22b7d15235f0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:06.438674 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-5ef9e065-7ee3-4096-9047-22b7d15235f0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:06.440109 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-5ef9e065-7ee3-4096-9047-22b7d15235f0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:06.441291 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-5ef9e065-7ee3-4096-9047-22b7d15235f0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1721 microversion: 2.20 time: 0.256247 Apr 30 13:19:06.441849 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 204/354] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:19:06 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1721 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:19:06.507735 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-5d3fb4f5-14e0-4842-8ae3-0591be47c2e8 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:06.508427 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-5d3fb4f5-14e0-4842-8ae3-0591be47c2e8 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 93d74a82-eb0b-4b65-bbe2-8960312e9dd8] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:06.516257 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5d3fb4f5-14e0-4842-8ae3-0591be47c2e8 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:06.516712 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5d3fb4f5-14e0-4842-8ae3-0591be47c2e8 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:06.517518 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5d3fb4f5-14e0-4842-8ae3-0591be47c2e8 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:06.517964 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5d3fb4f5-14e0-4842-8ae3-0591be47c2e8 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:06.562834 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-ab819ddb-3ee3-45a6-ad43-80e418d60b9f tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:06.572348 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-ab819ddb-3ee3-45a6-ad43-80e418d60b9f tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1520 microversion: 2.1 time: 0.394509 Apr 30 13:19:06.572923 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 151/355] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:06 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1520 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:06.594530 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-bbd5a0b2-fd97-4c61-84e2-0ed5831daf73 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:06.595210 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-bbd5a0b2-fd97-4c61-84e2-0ed5831daf73 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: 8ae91590-af1f-473b-9391-f77fe37593f2] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:06.603126 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-bbd5a0b2-fd97-4c61-84e2-0ed5831daf73 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:06.603510 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-bbd5a0b2-fd97-4c61-84e2-0ed5831daf73 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:06.604314 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-bbd5a0b2-fd97-4c61-84e2-0ed5831daf73 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:06.604764 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-bbd5a0b2-fd97-4c61-84e2-0ed5831daf73 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:06.733538 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-5d3fb4f5-14e0-4842-8ae3-0591be47c2e8 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:06.743408 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-5d3fb4f5-14e0-4842-8ae3-0591be47c2e8 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8" status: 200 len: 1318 microversion: 2.1 time: 0.240218 Apr 30 13:19:06.743998 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 205/356] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:06 2021] GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8 => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:19:06.829122 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-bbd5a0b2-fd97-4c61-84e2-0ed5831daf73 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:06.838022 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-bbd5a0b2-fd97-4c61-84e2-0ed5831daf73 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/8ae91590-af1f-473b-9391-f77fe37593f2" status: 200 len: 1319 microversion: 2.1 time: 0.246980 Apr 30 13:19:06.838593 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 152/357] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:06 2021] GET /compute/v2.1/servers/8ae91590-af1f-473b-9391-f77fe37593f2 => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:19:07.017262 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-a0d1d79a-bec2-49c3-b0a1-be00eb0edf3f tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:07.018140 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-a0d1d79a-bec2-49c3-b0a1-be00eb0edf3f tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 2050955f-b5e4-4bfb-9d57-cc100dd9c25b] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:07.026314 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a0d1d79a-bec2-49c3-b0a1-be00eb0edf3f tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:07.026773 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a0d1d79a-bec2-49c3-b0a1-be00eb0edf3f tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:07.027565 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a0d1d79a-bec2-49c3-b0a1-be00eb0edf3f tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:07.028008 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a0d1d79a-bec2-49c3-b0a1-be00eb0edf3f tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:07.229126 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-a0d1d79a-bec2-49c3-b0a1-be00eb0edf3f tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc9375be240416da7db978d32bd5531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079985bd0cc444091cb61ab2418c9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:07.238548 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-a0d1d79a-bec2-49c3-b0a1-be00eb0edf3f tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] 10.222.0.79 "GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b" status: 200 len: 1497 microversion: 2.1 time: 0.224939 Apr 30 13:19:07.239134 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 206/358] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:07 2021] GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b => generated 1497 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:07.462614 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-e0f16654-ec4d-4c69-b8a3-04fea4f67f01 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:07.463554 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-e0f16654-ec4d-4c69-b8a3-04fea4f67f01 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:07.471859 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e0f16654-ec4d-4c69-b8a3-04fea4f67f01 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:07.472870 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e0f16654-ec4d-4c69-b8a3-04fea4f67f01 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:07.474000 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e0f16654-ec4d-4c69-b8a3-04fea4f67f01 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:07.474803 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e0f16654-ec4d-4c69-b8a3-04fea4f67f01 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:07.589524 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-050148cd-da7b-43fc-8f92-42b6e0167990 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:07.590454 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-050148cd-da7b-43fc-8f92-42b6e0167990 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:07.600353 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-050148cd-da7b-43fc-8f92-42b6e0167990 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:07.600884 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-050148cd-da7b-43fc-8f92-42b6e0167990 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:07.601792 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-050148cd-da7b-43fc-8f92-42b6e0167990 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:07.602365 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-050148cd-da7b-43fc-8f92-42b6e0167990 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:07.734409 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-e0f16654-ec4d-4c69-b8a3-04fea4f67f01 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:07.751837 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-e0f16654-ec4d-4c69-b8a3-04fea4f67f01 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:07.754156 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-e0f16654-ec4d-4c69-b8a3-04fea4f67f01 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:07.756439 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-e0f16654-ec4d-4c69-b8a3-04fea4f67f01 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1721 microversion: 2.20 time: 0.299409 Apr 30 13:19:07.757580 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 153/359] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:19:07 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1721 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:19:07.763182 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-f551b5b6-e4fa-4317-b13f-10292f6e0965 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:07.764000 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-f551b5b6-e4fa-4317-b13f-10292f6e0965 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 93d74a82-eb0b-4b65-bbe2-8960312e9dd8] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:07.779969 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f551b5b6-e4fa-4317-b13f-10292f6e0965 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:07.779969 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f551b5b6-e4fa-4317-b13f-10292f6e0965 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:07.779969 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f551b5b6-e4fa-4317-b13f-10292f6e0965 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:07.779969 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f551b5b6-e4fa-4317-b13f-10292f6e0965 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:07.884610 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-050148cd-da7b-43fc-8f92-42b6e0167990 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:07.901987 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-050148cd-da7b-43fc-8f92-42b6e0167990 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1520 microversion: 2.1 time: 0.316125 Apr 30 13:19:07.902965 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 207/360] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:07 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1520 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:07.916207 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-fb396390-8077-49ad-bc70-13a3ee249be1 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:07.916833 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-fb396390-8077-49ad-bc70-13a3ee249be1 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: 8ae91590-af1f-473b-9391-f77fe37593f2] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:07.925183 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-fb396390-8077-49ad-bc70-13a3ee249be1 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:07.925671 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-fb396390-8077-49ad-bc70-13a3ee249be1 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:07.926611 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-fb396390-8077-49ad-bc70-13a3ee249be1 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:07.927061 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-fb396390-8077-49ad-bc70-13a3ee249be1 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:08.092579 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-f551b5b6-e4fa-4317-b13f-10292f6e0965 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:08.102236 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-f551b5b6-e4fa-4317-b13f-10292f6e0965 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8" status: 200 len: 1508 microversion: 2.1 time: 0.342651 Apr 30 13:19:08.102689 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 154/361] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:07 2021] GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8 => generated 1508 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:08.157854 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-fb396390-8077-49ad-bc70-13a3ee249be1 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:08.167964 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-fb396390-8077-49ad-bc70-13a3ee249be1 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/8ae91590-af1f-473b-9391-f77fe37593f2" status: 200 len: 1319 microversion: 2.1 time: 0.257628 Apr 30 13:19:08.168532 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 208/362] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:07 2021] GET /compute/v2.1/servers/8ae91590-af1f-473b-9391-f77fe37593f2 => generated 1319 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:08.472780 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-d4cdf983-5f38-449a-ac6a-3904432aae74 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:08.474601 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-d4cdf983-5f38-449a-ac6a-3904432aae74 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 2050955f-b5e4-4bfb-9d57-cc100dd9c25b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:08.486300 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d4cdf983-5f38-449a-ac6a-3904432aae74 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:08.487226 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d4cdf983-5f38-449a-ac6a-3904432aae74 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:08.488473 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d4cdf983-5f38-449a-ac6a-3904432aae74 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:08.489125 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d4cdf983-5f38-449a-ac6a-3904432aae74 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:08.567459 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-d4cdf983-5f38-449a-ac6a-3904432aae74 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 2050955f-b5e4-4bfb-9d57-cc100dd9c25b] Going to try to terminate instance {{(pid=87932) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 13:19:08.733165 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-d4cdf983-5f38-449a-ac6a-3904432aae74 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] 10.222.0.79 "DELETE /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b" status: 204 len: 0 microversion: 2.1 time: 0.264581 Apr 30 13:19:08.733960 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 155/363] 10.222.0.79 () {58 vars in 1239 bytes} [Fri Apr 30 13:19:08 2021] DELETE /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 13:19:08.743285 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-eea0cfee-0140-40e5-890f-d05bebf6b7ff tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:08.743856 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-eea0cfee-0140-40e5-890f-d05bebf6b7ff tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 2050955f-b5e4-4bfb-9d57-cc100dd9c25b] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:08.752581 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-eea0cfee-0140-40e5-890f-d05bebf6b7ff tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:08.752581 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-eea0cfee-0140-40e5-890f-d05bebf6b7ff tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:08.753532 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-eea0cfee-0140-40e5-890f-d05bebf6b7ff tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:08.753753 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-eea0cfee-0140-40e5-890f-d05bebf6b7ff tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:08.777581 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-ab2c8742-b4b1-4767-9c94-ffedced8bb5c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:08.778437 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-ab2c8742-b4b1-4767-9c94-ffedced8bb5c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:08.793689 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ab2c8742-b4b1-4767-9c94-ffedced8bb5c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:08.794445 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ab2c8742-b4b1-4767-9c94-ffedced8bb5c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:08.795562 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ab2c8742-b4b1-4767-9c94-ffedced8bb5c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:08.796319 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ab2c8742-b4b1-4767-9c94-ffedced8bb5c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:09.063781 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-eea0cfee-0140-40e5-890f-d05bebf6b7ff tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc9375be240416da7db978d32bd5531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079985bd0cc444091cb61ab2418c9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:09.075684 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-eea0cfee-0140-40e5-890f-d05bebf6b7ff tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] 10.222.0.79 "GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b" status: 200 len: 1503 microversion: 2.1 time: 0.336874 Apr 30 13:19:09.076537 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 209/364] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:08 2021] GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b => generated 1503 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:09.094800 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-d9da173b-3e12-4787-9b3e-6d7912aa69b7 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:09.096127 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-d9da173b-3e12-4787-9b3e-6d7912aa69b7 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:09.104293 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d9da173b-3e12-4787-9b3e-6d7912aa69b7 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:09.104756 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d9da173b-3e12-4787-9b3e-6d7912aa69b7 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:09.105560 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d9da173b-3e12-4787-9b3e-6d7912aa69b7 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:09.106238 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d9da173b-3e12-4787-9b3e-6d7912aa69b7 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:09.160685 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-ab2c8742-b4b1-4767-9c94-ffedced8bb5c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:09.171536 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-ab2c8742-b4b1-4767-9c94-ffedced8bb5c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:09.173887 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-ab2c8742-b4b1-4767-9c94-ffedced8bb5c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:09.179978 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-ab2c8742-b4b1-4767-9c94-ffedced8bb5c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1721 microversion: 2.20 time: 0.403809 Apr 30 13:19:09.192265 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 156/365] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:19:08 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1721 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:19:09.197576 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [req-8b0aed1e-688e-48a8-9bca-4b8f9ad0e82b req-a9f61e7d-adce-41aa-9e78-58973045a040 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ae91590-af1f-473b-9391-f77fe37593f2", "name": "network-vif-plugged", "status": "completed", "tag": "25347b02-eba4-4cb1-8902-90ae885f45d1"}]} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:19:09.199566 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:19:09.199566 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: warnings.warn(msg) Apr 30 13:19:09.208646 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-8b0aed1e-688e-48a8-9bca-4b8f9ad0e82b req-a9f61e7d-adce-41aa-9e78-58973045a040 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:09.209094 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-8b0aed1e-688e-48a8-9bca-4b8f9ad0e82b req-a9f61e7d-adce-41aa-9e78-58973045a040 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:09.239220 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.compute.server_external_events [req-8b0aed1e-688e-48a8-9bca-4b8f9ad0e82b req-a9f61e7d-adce-41aa-9e78-58973045a040 service nova] Creating event network-vif-plugged:25347b02-eba4-4cb1-8902-90ae885f45d1 for instance 8ae91590-af1f-473b-9391-f77fe37593f2 on hv-cinder-78836 Apr 30 13:19:09.245469 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [req-8b0aed1e-688e-48a8-9bca-4b8f9ad0e82b req-a9f61e7d-adce-41aa-9e78-58973045a040 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051791 Apr 30 13:19:09.247708 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 157/366] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:19:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:19:09.253670 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-7df32b7c-cb56-4b52-b4b0-f3075e2c0d7d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:09.254483 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-7df32b7c-cb56-4b52-b4b0-f3075e2c0d7d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: 8ae91590-af1f-473b-9391-f77fe37593f2] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:09.263534 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7df32b7c-cb56-4b52-b4b0-f3075e2c0d7d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:09.263805 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7df32b7c-cb56-4b52-b4b0-f3075e2c0d7d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:09.264619 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7df32b7c-cb56-4b52-b4b0-f3075e2c0d7d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:09.264996 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7df32b7c-cb56-4b52-b4b0-f3075e2c0d7d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:09.457675 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-d9da173b-3e12-4787-9b3e-6d7912aa69b7 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:09.467326 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-d9da173b-3e12-4787-9b3e-6d7912aa69b7 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1500 microversion: 2.1 time: 0.377681 Apr 30 13:19:09.468061 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 210/367] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:09 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1500 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:09.486916 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-869dcf65-e280-44d1-a036-6942d8476007 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "75de391e-797c-4d3d-bf6d-ac0b7564757d"}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:19:09.488343 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-869dcf65-e280-44d1-a036-6942d8476007 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:09.497679 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-869dcf65-e280-44d1-a036-6942d8476007 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:09.498703 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-869dcf65-e280-44d1-a036-6942d8476007 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:09.499424 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-869dcf65-e280-44d1-a036-6942d8476007 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:09.499903 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-869dcf65-e280-44d1-a036-6942d8476007 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:09.508007 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-7df32b7c-cb56-4b52-b4b0-f3075e2c0d7d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:09.520667 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-7df32b7c-cb56-4b52-b4b0-f3075e2c0d7d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/8ae91590-af1f-473b-9391-f77fe37593f2" status: 200 len: 1319 microversion: 2.1 time: 0.272085 Apr 30 13:19:09.522160 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 158/368] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:09 2021] GET /compute/v2.1/servers/8ae91590-af1f-473b-9391-f77fe37593f2 => generated 1319 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:09.562981 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.wsgi [None req-869dcf65-e280-44d1-a036-6942d8476007 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] HTTP exception thrown: Cannot 'attach_volume' instance aa7277ee-287a-481c-a0e8-ae4dc4053a0e while it is in vm_state rescued Apr 30 13:19:09.563688 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-869dcf65-e280-44d1-a036-6942d8476007 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Returning 409 to user: Cannot 'attach_volume' instance aa7277ee-287a-481c-a0e8-ae4dc4053a0e while it is in vm_state rescued {{(pid=87933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:19:09.564721 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-869dcf65-e280-44d1-a036-6942d8476007 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "POST /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.083385 Apr 30 13:19:09.565374 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 211/369] 10.222.0.79 () {60 vars in 1323 bytes} [Fri Apr 30 13:19:09 2021] POST /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e/os-volume_attachments => generated 152 bytes in 85 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 30 13:19:09.574823 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-8983222e-3347-4c5d-b015-450c0999a94a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:19:09.575691 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-8983222e-3347-4c5d-b015-450c0999a94a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:09.586227 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8983222e-3347-4c5d-b015-450c0999a94a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:09.586951 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8983222e-3347-4c5d-b015-450c0999a94a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:09.587852 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8983222e-3347-4c5d-b015-450c0999a94a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:09.588432 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8983222e-3347-4c5d-b015-450c0999a94a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:09.758367 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-8983222e-3347-4c5d-b015-450c0999a94a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "POST /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e/action" status: 202 len: 0 microversion: 2.1 time: 0.178806 Apr 30 13:19:09.758367 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 159/370] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:19:09 2021] POST /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 13:19:09.760518 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-0a56d6f1-77c5-4c37-a399-0600481e98d6 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:09.761340 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-0a56d6f1-77c5-4c37-a399-0600481e98d6 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:09.769542 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0a56d6f1-77c5-4c37-a399-0600481e98d6 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:09.769930 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-2c447ff6-e988-4abb-b109-6297db7ee010 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dcb4fd68-313e-4a04-9f51-03f6693fd993"}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:19:09.770829 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0a56d6f1-77c5-4c37-a399-0600481e98d6 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:09.771885 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-2c447ff6-e988-4abb-b109-6297db7ee010 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 93d74a82-eb0b-4b65-bbe2-8960312e9dd8] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:09.772177 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0a56d6f1-77c5-4c37-a399-0600481e98d6 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:09.772904 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0a56d6f1-77c5-4c37-a399-0600481e98d6 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:09.782419 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2c447ff6-e988-4abb-b109-6297db7ee010 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:09.782881 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2c447ff6-e988-4abb-b109-6297db7ee010 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:09.784799 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2c447ff6-e988-4abb-b109-6297db7ee010 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:09.785294 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2c447ff6-e988-4abb-b109-6297db7ee010 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:10.027117 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-0a56d6f1-77c5-4c37-a399-0600481e98d6 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:10.035737 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-0a56d6f1-77c5-4c37-a399-0600481e98d6 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1508 microversion: 2.1 time: 0.280329 Apr 30 13:19:10.037111 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 212/371] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:09 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1508 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:10.096654 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-ba3cc234-2416-4f3f-b512-46d858559a46 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:10.097289 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-ba3cc234-2416-4f3f-b512-46d858559a46 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 2050955f-b5e4-4bfb-9d57-cc100dd9c25b] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:10.106091 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ba3cc234-2416-4f3f-b512-46d858559a46 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:10.106588 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ba3cc234-2416-4f3f-b512-46d858559a46 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:10.107378 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ba3cc234-2416-4f3f-b512-46d858559a46 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:10.108048 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ba3cc234-2416-4f3f-b512-46d858559a46 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:10.350549 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-ba3cc234-2416-4f3f-b512-46d858559a46 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc9375be240416da7db978d32bd5531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079985bd0cc444091cb61ab2418c9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:10.359806 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-ba3cc234-2416-4f3f-b512-46d858559a46 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] 10.222.0.79 "GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b" status: 200 len: 1503 microversion: 2.1 time: 0.267857 Apr 30 13:19:10.360958 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 213/372] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:10 2021] GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b => generated 1503 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:10.365640 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-593a8548-3c1b-45ea-97ca-887725068551 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:10.366431 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-593a8548-3c1b-45ea-97ca-887725068551 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:10.374161 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-593a8548-3c1b-45ea-97ca-887725068551 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:10.374613 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-593a8548-3c1b-45ea-97ca-887725068551 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:10.375399 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-593a8548-3c1b-45ea-97ca-887725068551 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:10.375833 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-593a8548-3c1b-45ea-97ca-887725068551 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:10.620935 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-593a8548-3c1b-45ea-97ca-887725068551 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:10.633736 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-593a8548-3c1b-45ea-97ca-887725068551 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:10.637105 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-593a8548-3c1b-45ea-97ca-887725068551 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:10.637640 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-2c447ff6-e988-4abb-b109-6297db7ee010 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "POST /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.875118 Apr 30 13:19:10.638730 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 160/373] 10.222.0.79 () {60 vars in 1323 bytes} [Fri Apr 30 13:19:09 2021] POST /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8/os-volume_attachments => generated 194 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:19:10.639688 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-593a8548-3c1b-45ea-97ca-887725068551 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1721 microversion: 2.20 time: 0.277470 Apr 30 13:19:10.640279 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 214/374] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:19:10 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1721 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:19:10.646001 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-64a2bf62-1373-426b-8180-1bad631992c4 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:10.647858 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-64a2bf62-1373-426b-8180-1bad631992c4 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: 8ae91590-af1f-473b-9391-f77fe37593f2] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:10.656857 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-64a2bf62-1373-426b-8180-1bad631992c4 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:10.657795 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-64a2bf62-1373-426b-8180-1bad631992c4 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:10.658786 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-64a2bf62-1373-426b-8180-1bad631992c4 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:10.659371 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-64a2bf62-1373-426b-8180-1bad631992c4 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:11.055304 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-1192120d-a9c9-4850-a95f-95f27600e064 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:11.055964 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-1192120d-a9c9-4850-a95f-95f27600e064 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:11.064598 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1192120d-a9c9-4850-a95f-95f27600e064 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:11.065338 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1192120d-a9c9-4850-a95f-95f27600e064 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:11.066359 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1192120d-a9c9-4850-a95f-95f27600e064 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:11.066989 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1192120d-a9c9-4850-a95f-95f27600e064 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:11.188140 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-64a2bf62-1373-426b-8180-1bad631992c4 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:11.198960 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-64a2bf62-1373-426b-8180-1bad631992c4 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/8ae91590-af1f-473b-9391-f77fe37593f2" status: 200 len: 1319 microversion: 2.1 time: 0.558566 Apr 30 13:19:11.203056 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 161/375] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:10 2021] GET /compute/v2.1/servers/8ae91590-af1f-473b-9391-f77fe37593f2 => generated 1319 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:11.309865 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-1192120d-a9c9-4850-a95f-95f27600e064 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:11.318993 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-1192120d-a9c9-4850-a95f-95f27600e064 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1508 microversion: 2.1 time: 0.268433 Apr 30 13:19:11.319765 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 215/376] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:11 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1508 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:19:11.378095 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-84822f91-cb6d-40fb-a399-38d7c1a455ae tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:11.378851 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-84822f91-cb6d-40fb-a399-38d7c1a455ae tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 2050955f-b5e4-4bfb-9d57-cc100dd9c25b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:11.386895 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-84822f91-cb6d-40fb-a399-38d7c1a455ae tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:11.387498 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-84822f91-cb6d-40fb-a399-38d7c1a455ae tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:11.388447 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-84822f91-cb6d-40fb-a399-38d7c1a455ae tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:11.389018 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-84822f91-cb6d-40fb-a399-38d7c1a455ae tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:11.610503 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-84822f91-cb6d-40fb-a399-38d7c1a455ae tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc9375be240416da7db978d32bd5531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079985bd0cc444091cb61ab2418c9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:11.619724 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-84822f91-cb6d-40fb-a399-38d7c1a455ae tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] 10.222.0.79 "GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b" status: 200 len: 1503 microversion: 2.1 time: 0.245635 Apr 30 13:19:11.620392 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 162/377] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:11 2021] GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b => generated 1503 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:11.658447 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-982d0216-8036-4218-9ea5-8865f4902fec tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:11.659242 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-982d0216-8036-4218-9ea5-8865f4902fec tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:11.668024 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-982d0216-8036-4218-9ea5-8865f4902fec tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:11.668571 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-982d0216-8036-4218-9ea5-8865f4902fec tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:11.669492 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-982d0216-8036-4218-9ea5-8865f4902fec tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:11.669966 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-982d0216-8036-4218-9ea5-8865f4902fec tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:11.916254 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-982d0216-8036-4218-9ea5-8865f4902fec tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:11.926042 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-982d0216-8036-4218-9ea5-8865f4902fec tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:11.927689 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-982d0216-8036-4218-9ea5-8865f4902fec tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:11.928844 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-982d0216-8036-4218-9ea5-8865f4902fec tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1721 microversion: 2.20 time: 0.274608 Apr 30 13:19:11.929415 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 216/378] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:19:11 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1721 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:19:12.221136 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-e11567ad-fb48-4445-b43f-556c073ac071 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:12.221751 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-e11567ad-fb48-4445-b43f-556c073ac071 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: 8ae91590-af1f-473b-9391-f77fe37593f2] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:12.230272 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e11567ad-fb48-4445-b43f-556c073ac071 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:12.230722 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e11567ad-fb48-4445-b43f-556c073ac071 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:12.231517 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e11567ad-fb48-4445-b43f-556c073ac071 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:12.231952 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e11567ad-fb48-4445-b43f-556c073ac071 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:12.337071 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-0847bd1d-9831-401c-b460-d504765cba35 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:12.337727 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-0847bd1d-9831-401c-b460-d504765cba35 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:12.345576 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0847bd1d-9831-401c-b460-d504765cba35 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:12.346166 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0847bd1d-9831-401c-b460-d504765cba35 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:12.347614 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0847bd1d-9831-401c-b460-d504765cba35 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:12.348121 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0847bd1d-9831-401c-b460-d504765cba35 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:12.495289 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-e11567ad-fb48-4445-b43f-556c073ac071 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:12.503728 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-e11567ad-fb48-4445-b43f-556c073ac071 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/8ae91590-af1f-473b-9391-f77fe37593f2" status: 200 len: 1508 microversion: 2.1 time: 0.287899 Apr 30 13:19:12.504310 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 163/379] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:12 2021] GET /compute/v2.1/servers/8ae91590-af1f-473b-9391-f77fe37593f2 => generated 1508 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:12.571923 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-0847bd1d-9831-401c-b460-d504765cba35 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:12.580596 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-0847bd1d-9831-401c-b460-d504765cba35 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1508 microversion: 2.1 time: 0.248027 Apr 30 13:19:12.581180 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 217/380] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:12 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1508 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:19:12.637164 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-8bcf97f6-ce30-4847-936e-74fec9bccde7 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:12.638123 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-8bcf97f6-ce30-4847-936e-74fec9bccde7 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 2050955f-b5e4-4bfb-9d57-cc100dd9c25b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:12.645668 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8bcf97f6-ce30-4847-936e-74fec9bccde7 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:12.646351 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8bcf97f6-ce30-4847-936e-74fec9bccde7 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:12.647153 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8bcf97f6-ce30-4847-936e-74fec9bccde7 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:12.647586 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8bcf97f6-ce30-4847-936e-74fec9bccde7 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:12.947283 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-7f6f8f74-68d1-43ab-8994-6eb2a404ee0e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:12.948018 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-7f6f8f74-68d1-43ab-8994-6eb2a404ee0e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:12.959786 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7f6f8f74-68d1-43ab-8994-6eb2a404ee0e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:12.960284 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7f6f8f74-68d1-43ab-8994-6eb2a404ee0e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:12.961870 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7f6f8f74-68d1-43ab-8994-6eb2a404ee0e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:12.962575 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7f6f8f74-68d1-43ab-8994-6eb2a404ee0e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:13.034827 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-8bcf97f6-ce30-4847-936e-74fec9bccde7 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc9375be240416da7db978d32bd5531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079985bd0cc444091cb61ab2418c9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:13.048375 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-8bcf97f6-ce30-4847-936e-74fec9bccde7 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] 10.222.0.79 "GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b" status: 200 len: 1503 microversion: 2.1 time: 0.414891 Apr 30 13:19:13.048958 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 164/381] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:12 2021] GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b => generated 1503 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:13.318782 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-7f6f8f74-68d1-43ab-8994-6eb2a404ee0e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:13.329298 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-7f6f8f74-68d1-43ab-8994-6eb2a404ee0e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:13.331110 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-7f6f8f74-68d1-43ab-8994-6eb2a404ee0e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:13.332732 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-7f6f8f74-68d1-43ab-8994-6eb2a404ee0e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1721 microversion: 2.20 time: 0.389600 Apr 30 13:19:13.344453 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 218/382] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:19:12 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1721 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:19:13.597713 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-2ce76dd4-77e9-49a0-b24f-0f9d18d2470f tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:13.598406 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-2ce76dd4-77e9-49a0-b24f-0f9d18d2470f tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:13.624735 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2ce76dd4-77e9-49a0-b24f-0f9d18d2470f tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:13.625714 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2ce76dd4-77e9-49a0-b24f-0f9d18d2470f tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:13.629195 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2ce76dd4-77e9-49a0-b24f-0f9d18d2470f tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:13.632214 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2ce76dd4-77e9-49a0-b24f-0f9d18d2470f tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:13.740638 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [req-c07e0c8f-0357-479b-8fe8-30429d295940 req-acced77f-7c63-4e43-ab0d-c4bbe2c395ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2050955f-b5e4-4bfb-9d57-cc100dd9c25b", "name": "network-vif-deleted", "tag": "6bf679fb-169f-4d67-b161-f2a15b38dde6"}]} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:19:13.742988 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:19:13.742988 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: warnings.warn(msg) Apr 30 13:19:13.759255 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-c07e0c8f-0357-479b-8fe8-30429d295940 req-acced77f-7c63-4e43-ab0d-c4bbe2c395ad service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:13.759846 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-c07e0c8f-0357-479b-8fe8-30429d295940 req-acced77f-7c63-4e43-ab0d-c4bbe2c395ad service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:13.780407 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.compute.server_external_events [req-c07e0c8f-0357-479b-8fe8-30429d295940 req-acced77f-7c63-4e43-ab0d-c4bbe2c395ad service nova] Creating event network-vif-deleted:6bf679fb-169f-4d67-b161-f2a15b38dde6 for instance 2050955f-b5e4-4bfb-9d57-cc100dd9c25b on hv-cinder-78836 Apr 30 13:19:13.788053 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [req-c07e0c8f-0357-479b-8fe8-30429d295940 req-acced77f-7c63-4e43-ab0d-c4bbe2c395ad service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051244 Apr 30 13:19:13.788633 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 219/383] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:19:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:19:13.928110 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-2ce76dd4-77e9-49a0-b24f-0f9d18d2470f tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:13.936433 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-2ce76dd4-77e9-49a0-b24f-0f9d18d2470f tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1508 microversion: 2.1 time: 0.342443 Apr 30 13:19:13.937187 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 165/384] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:13 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1508 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:14.073683 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-a0aed8e3-0f8c-4363-8e04-26fcc42f0f8d tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:14.074521 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-a0aed8e3-0f8c-4363-8e04-26fcc42f0f8d tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 2050955f-b5e4-4bfb-9d57-cc100dd9c25b] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:14.082865 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a0aed8e3-0f8c-4363-8e04-26fcc42f0f8d tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:14.083857 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a0aed8e3-0f8c-4363-8e04-26fcc42f0f8d tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:14.084867 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a0aed8e3-0f8c-4363-8e04-26fcc42f0f8d tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:14.085469 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a0aed8e3-0f8c-4363-8e04-26fcc42f0f8d tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:14.165041 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a0aed8e3-0f8c-4363-8e04-26fcc42f0f8d tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:14.165866 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a0aed8e3-0f8c-4363-8e04-26fcc42f0f8d tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:14.166686 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.objects.instance [None req-a0aed8e3-0f8c-4363-8e04-26fcc42f0f8d tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lazy-loading 'fault' on Instance uuid 2050955f-b5e4-4bfb-9d57-cc100dd9c25b {{(pid=87933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:19:14.236205 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-a0aed8e3-0f8c-4363-8e04-26fcc42f0f8d tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc9375be240416da7db978d32bd5531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079985bd0cc444091cb61ab2418c9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:14.247752 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-a0aed8e3-0f8c-4363-8e04-26fcc42f0f8d tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] 10.222.0.79 "GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b" status: 200 len: 1304 microversion: 2.1 time: 0.178411 Apr 30 13:19:14.248411 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 220/385] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:14 2021] GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b => generated 1304 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:14.354114 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-67cbb7be-5ff6-41e3-a9e0-0dda362b163b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:14.354983 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-67cbb7be-5ff6-41e3-a9e0-0dda362b163b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:14.365240 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-67cbb7be-5ff6-41e3-a9e0-0dda362b163b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:14.365967 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-67cbb7be-5ff6-41e3-a9e0-0dda362b163b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:14.366909 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-67cbb7be-5ff6-41e3-a9e0-0dda362b163b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:14.367366 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-67cbb7be-5ff6-41e3-a9e0-0dda362b163b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:14.652761 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-67cbb7be-5ff6-41e3-a9e0-0dda362b163b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:14.663195 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-67cbb7be-5ff6-41e3-a9e0-0dda362b163b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:14.664283 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-67cbb7be-5ff6-41e3-a9e0-0dda362b163b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:14.665433 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-67cbb7be-5ff6-41e3-a9e0-0dda362b163b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1721 microversion: 2.20 time: 0.317406 Apr 30 13:19:14.666030 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 166/386] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:19:14 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1721 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:19:14.953459 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-0ac3397c-347a-4607-8663-0e4ddf0efdf1 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:14.954109 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-0ac3397c-347a-4607-8663-0e4ddf0efdf1 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:14.962569 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0ac3397c-347a-4607-8663-0e4ddf0efdf1 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:14.963023 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0ac3397c-347a-4607-8663-0e4ddf0efdf1 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:14.963808 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0ac3397c-347a-4607-8663-0e4ddf0efdf1 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:14.964242 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0ac3397c-347a-4607-8663-0e4ddf0efdf1 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:15.178602 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-0ac3397c-347a-4607-8663-0e4ddf0efdf1 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:15.188079 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-0ac3397c-347a-4607-8663-0e4ddf0efdf1 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1508 microversion: 2.1 time: 0.238445 Apr 30 13:19:15.188696 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 221/387] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:14 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1508 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:19:15.269712 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-9f3662ac-71b3-4dc0-8265-47c50ccc3650 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:15.270503 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-9f3662ac-71b3-4dc0-8265-47c50ccc3650 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 2050955f-b5e4-4bfb-9d57-cc100dd9c25b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:15.281398 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9f3662ac-71b3-4dc0-8265-47c50ccc3650 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:15.281955 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9f3662ac-71b3-4dc0-8265-47c50ccc3650 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:15.282838 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9f3662ac-71b3-4dc0-8265-47c50ccc3650 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:15.283341 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9f3662ac-71b3-4dc0-8265-47c50ccc3650 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:15.342336 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.wsgi [None req-9f3662ac-71b3-4dc0-8265-47c50ccc3650 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] HTTP exception thrown: Instance 2050955f-b5e4-4bfb-9d57-cc100dd9c25b could not be found. Apr 30 13:19:15.343738 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-9f3662ac-71b3-4dc0-8265-47c50ccc3650 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Returning 404 to user: Instance 2050955f-b5e4-4bfb-9d57-cc100dd9c25b could not be found. {{(pid=87932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:19:15.345187 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-9f3662ac-71b3-4dc0-8265-47c50ccc3650 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] 10.222.0.79 "GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b" status: 404 len: 111 microversion: 2.1 time: 0.081083 Apr 30 13:19:15.349653 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 167/388] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:15 2021] GET /compute/v2.1/servers/2050955f-b5e4-4bfb-9d57-cc100dd9c25b => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:19:15.481758 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-ac999cba-07ec-4621-a16c-5b2f0e0b66db tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1953986784", "imageRef": "705a0c6b-b003-4687-84bf-8b9f87dae39e", "flavorRef": "452", "networks": [{"uuid": "aaedd0c6-8067-4afd-bcb2-ecc8e1a55154"}]}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:19:15.684164 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-7e5ea2b0-4224-411b-acbb-6b324cc0aedb tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:15.684778 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-7e5ea2b0-4224-411b-acbb-6b324cc0aedb tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:15.694332 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7e5ea2b0-4224-411b-acbb-6b324cc0aedb tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:15.695080 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7e5ea2b0-4224-411b-acbb-6b324cc0aedb tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:15.696286 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7e5ea2b0-4224-411b-acbb-6b324cc0aedb tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:15.696894 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7e5ea2b0-4224-411b-acbb-6b324cc0aedb tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:15.923863 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-7e5ea2b0-4224-411b-acbb-6b324cc0aedb tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:15.935899 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-7e5ea2b0-4224-411b-acbb-6b324cc0aedb tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:15.939967 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-7e5ea2b0-4224-411b-acbb-6b324cc0aedb tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:15.939967 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-7e5ea2b0-4224-411b-acbb-6b324cc0aedb tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1721 microversion: 2.20 time: 0.258536 Apr 30 13:19:15.939967 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 168/389] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:19:15 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1721 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:19:16.213791 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-f6f03634-7c9c-4f5e-b7df-477e72f3243a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:16.213791 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-f6f03634-7c9c-4f5e-b7df-477e72f3243a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:16.216699 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f6f03634-7c9c-4f5e-b7df-477e72f3243a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:16.217156 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f6f03634-7c9c-4f5e-b7df-477e72f3243a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:16.218120 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f6f03634-7c9c-4f5e-b7df-477e72f3243a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:16.218561 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f6f03634-7c9c-4f5e-b7df-477e72f3243a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:16.431831 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-f6f03634-7c9c-4f5e-b7df-477e72f3243a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:16.440829 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-f6f03634-7c9c-4f5e-b7df-477e72f3243a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1514 microversion: 2.1 time: 0.238549 Apr 30 13:19:16.441792 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 169/390] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:16 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1514 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:19:16.956627 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-7c9fc901-d840-4969-803a-e0dfa6a5994d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:16.958085 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-7c9fc901-d840-4969-803a-e0dfa6a5994d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:16.965695 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7c9fc901-d840-4969-803a-e0dfa6a5994d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:16.966188 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7c9fc901-d840-4969-803a-e0dfa6a5994d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:16.967285 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7c9fc901-d840-4969-803a-e0dfa6a5994d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:16.968094 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7c9fc901-d840-4969-803a-e0dfa6a5994d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:17.183524 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-7c9fc901-d840-4969-803a-e0dfa6a5994d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:17.193972 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-7c9fc901-d840-4969-803a-e0dfa6a5994d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:17.195092 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-7c9fc901-d840-4969-803a-e0dfa6a5994d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:17.196253 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-7c9fc901-d840-4969-803a-e0dfa6a5994d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1721 microversion: 2.20 time: 0.243528 Apr 30 13:19:17.196812 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 170/391] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:19:16 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1721 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:19:18.058786 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-7a7ffa1b-85ad-4631-9a3e-dc80bafd9841 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:18.059669 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-7a7ffa1b-85ad-4631-9a3e-dc80bafd9841 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:18.068476 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7a7ffa1b-85ad-4631-9a3e-dc80bafd9841 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:18.072319 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7a7ffa1b-85ad-4631-9a3e-dc80bafd9841 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:18.073267 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7a7ffa1b-85ad-4631-9a3e-dc80bafd9841 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:18.073719 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7a7ffa1b-85ad-4631-9a3e-dc80bafd9841 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:18.308069 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-7a7ffa1b-85ad-4631-9a3e-dc80bafd9841 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:18.318382 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-7a7ffa1b-85ad-4631-9a3e-dc80bafd9841 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1514 microversion: 2.1 time: 0.264683 Apr 30 13:19:18.319667 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 171/392] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:18 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1514 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:19:18.328178 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-e1c0366f-93d5-4525-abaa-fc56466f029c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:18.329227 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-e1c0366f-93d5-4525-abaa-fc56466f029c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:18.341560 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e1c0366f-93d5-4525-abaa-fc56466f029c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:18.342365 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e1c0366f-93d5-4525-abaa-fc56466f029c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:18.343673 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e1c0366f-93d5-4525-abaa-fc56466f029c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:18.344394 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e1c0366f-93d5-4525-abaa-fc56466f029c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:18.610656 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-e1c0366f-93d5-4525-abaa-fc56466f029c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:18.632274 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-e1c0366f-93d5-4525-abaa-fc56466f029c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:18.632274 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-e1c0366f-93d5-4525-abaa-fc56466f029c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:18.632274 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-e1c0366f-93d5-4525-abaa-fc56466f029c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1721 microversion: 2.20 time: 0.309531 Apr 30 13:19:18.632674 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 172/393] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:19:18 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1721 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:19:18.637375 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-12a96516-0992-4093-88c3-61a6549a73a5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a7e6e7b0-0c46-4275-9fbb-194d67197568"}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:19:18.638707 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-12a96516-0992-4093-88c3-61a6549a73a5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:18.647893 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-12a96516-0992-4093-88c3-61a6549a73a5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:18.648381 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-12a96516-0992-4093-88c3-61a6549a73a5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:18.649420 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-12a96516-0992-4093-88c3-61a6549a73a5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:18.649713 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-12a96516-0992-4093-88c3-61a6549a73a5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:19.078154 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.network.neutron [None req-ac999cba-07ec-4621-a16c-5b2f0e0b66db tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] validate_networks() for [('aaedd0c6-8067-4afd-bcb2-ecc8e1a55154', None, None, None)] {{(pid=87933) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 13:19:19.291827 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-12a96516-0992-4093-88c3-61a6549a73a5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "POST /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.658154 Apr 30 13:19:19.292871 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 173/394] 10.222.0.79 () {60 vars in 1323 bytes} [Fri Apr 30 13:19:18 2021] POST /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e/os-volume_attachments => generated 194 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:19:19.651159 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-c68206e3-3bca-436d-8d3f-4824b06ad9f7 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:19.652561 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-c68206e3-3bca-436d-8d3f-4824b06ad9f7 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:19.665572 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c68206e3-3bca-436d-8d3f-4824b06ad9f7 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:19.666467 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c68206e3-3bca-436d-8d3f-4824b06ad9f7 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:19.667620 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c68206e3-3bca-436d-8d3f-4824b06ad9f7 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:19.668220 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c68206e3-3bca-436d-8d3f-4824b06ad9f7 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:19.916390 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-c68206e3-3bca-436d-8d3f-4824b06ad9f7 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:19.928137 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-c68206e3-3bca-436d-8d3f-4824b06ad9f7 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:19.929928 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-c68206e3-3bca-436d-8d3f-4824b06ad9f7 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:19.931345 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-c68206e3-3bca-436d-8d3f-4824b06ad9f7 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1742 microversion: 2.20 time: 0.284820 Apr 30 13:19:19.931958 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 174/395] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:19:19 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1742 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:19:19.973378 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.virt.hardware [None req-ac999cba-07ec-4621-a16c-5b2f0e0b66db tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Flavor limits 0:0:0 {{(pid=87933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 13:19:19.974250 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.virt.hardware [None req-ac999cba-07ec-4621-a16c-5b2f0e0b66db tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Image limits 0:0:0 {{(pid=87933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 13:19:19.975042 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.virt.hardware [None req-ac999cba-07ec-4621-a16c-5b2f0e0b66db tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Flavor pref 0:0:0 {{(pid=87933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 13:19:19.975642 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.virt.hardware [None req-ac999cba-07ec-4621-a16c-5b2f0e0b66db tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Image pref 0:0:0 {{(pid=87933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 13:19:19.976365 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.virt.hardware [None req-ac999cba-07ec-4621-a16c-5b2f0e0b66db tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 13:19:19.990628 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ac999cba-07ec-4621-a16c-5b2f0e0b66db tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:19.991381 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ac999cba-07ec-4621-a16c-5b2f0e0b66db tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:19.992695 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ac999cba-07ec-4621-a16c-5b2f0e0b66db tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:19.993303 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ac999cba-07ec-4621-a16c-5b2f0e0b66db tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:20.025194 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.quota [None req-ac999cba-07ec-4621-a16c-5b2f0e0b66db tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Getting quotas for project 9079985bd0cc444091cb61ab2418c9a0. Resources: {'ram', 'instances', 'cores'} {{(pid=87933) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:19:20.032460 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.quota [None req-ac999cba-07ec-4621-a16c-5b2f0e0b66db tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Getting quotas for user fbc9375be240416da7db978d32bd5531 and project 9079985bd0cc444091cb61ab2418c9a0. Resources: {'ram', 'instances', 'cores'} {{(pid=87933) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:19:20.043991 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-edcac454-5c9e-466e-bd19-aeeef48d1682 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dcb4fd68-313e-4a04-9f51-03f6693fd993"}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:19:20.045565 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-edcac454-5c9e-466e-bd19-aeeef48d1682 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 93d74a82-eb0b-4b65-bbe2-8960312e9dd8] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:20.051280 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-ac999cba-07ec-4621-a16c-5b2f0e0b66db tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Going to run 1 instances... {{(pid=87933) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 13:19:20.054881 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-edcac454-5c9e-466e-bd19-aeeef48d1682 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:20.054881 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-edcac454-5c9e-466e-bd19-aeeef48d1682 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:20.055333 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-edcac454-5c9e-466e-bd19-aeeef48d1682 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:20.055787 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-edcac454-5c9e-466e-bd19-aeeef48d1682 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:20.056224 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-ac999cba-07ec-4621-a16c-5b2f0e0b66db tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 7fde42c1-2604-43e4-a825-3c3e3b38ca92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='705a0c6b-b003-4687-84bf-8b9f87dae39e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=87933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 13:19:20.115678 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-ac999cba-07ec-4621-a16c-5b2f0e0b66db tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.645335 Apr 30 13:19:20.124615 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 222/396] 10.222.0.79 () {60 vars in 1147 bytes} [Fri Apr 30 13:19:15 2021] POST /compute/v2.1/servers => generated 380 bytes in 4655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 13:19:20.130857 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-ab3b3e39-9a53-413a-89a0-45a0213a1bad tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:20.132004 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-ab3b3e39-9a53-413a-89a0-45a0213a1bad tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 7fde42c1-2604-43e4-a825-3c3e3b38ca92] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:20.222950 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-ab3b3e39-9a53-413a-89a0-45a0213a1bad tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc9375be240416da7db978d32bd5531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079985bd0cc444091cb61ab2418c9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:20.233829 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-ab3b3e39-9a53-413a-89a0-45a0213a1bad tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] 10.222.0.79 "GET /compute/v2.1/servers/7fde42c1-2604-43e4-a825-3c3e3b38ca92" status: 200 len: 1214 microversion: 2.1 time: 0.107467 Apr 30 13:19:20.234573 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 223/397] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:20 2021] GET /compute/v2.1/servers/7fde42c1-2604-43e4-a825-3c3e3b38ca92 => generated 1214 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:20.431669 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.wsgi [None req-edcac454-5c9e-466e-bd19-aeeef48d1682 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] HTTP exception thrown: Invalid volume: volume dcb4fd68-313e-4a04-9f51-03f6693fd993 is already attached to instances: 93d74a82-eb0b-4b65-bbe2-8960312e9dd8 Apr 30 13:19:20.432377 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-edcac454-5c9e-466e-bd19-aeeef48d1682 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Returning 400 to user: Invalid volume: volume dcb4fd68-313e-4a04-9f51-03f6693fd993 is already attached to instances: 93d74a82-eb0b-4b65-bbe2-8960312e9dd8 {{(pid=87932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:19:20.433463 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-edcac454-5c9e-466e-bd19-aeeef48d1682 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "POST /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.393491 Apr 30 13:19:20.434423 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 175/398] 10.222.0.79 () {60 vars in 1323 bytes} [Fri Apr 30 13:19:20 2021] POST /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8/os-volume_attachments => generated 174 bytes in 395 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 30 13:19:20.556636 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-55083a50-ee59-4db6-9610-63f91d7ae4ef tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:20.557398 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-55083a50-ee59-4db6-9610-63f91d7ae4ef tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 93d74a82-eb0b-4b65-bbe2-8960312e9dd8] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:20.571007 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-55083a50-ee59-4db6-9610-63f91d7ae4ef tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:20.571467 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-55083a50-ee59-4db6-9610-63f91d7ae4ef tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:20.572260 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-55083a50-ee59-4db6-9610-63f91d7ae4ef tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:20.572693 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-55083a50-ee59-4db6-9610-63f91d7ae4ef tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:20.816754 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.objects.instance [None req-55083a50-ee59-4db6-9610-63f91d7ae4ef tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lazy-loading 'services' on Instance uuid 93d74a82-eb0b-4b65-bbe2-8960312e9dd8 {{(pid=87933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:19:20.955096 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-86f0dff4-8d58-44ec-92bc-a56589da99cc tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:20.955886 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-86f0dff4-8d58-44ec-92bc-a56589da99cc tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:20.972159 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-86f0dff4-8d58-44ec-92bc-a56589da99cc tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:20.972956 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-86f0dff4-8d58-44ec-92bc-a56589da99cc tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:20.974932 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-86f0dff4-8d58-44ec-92bc-a56589da99cc tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:20.976364 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-86f0dff4-8d58-44ec-92bc-a56589da99cc tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:21.023163 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-55083a50-ee59-4db6-9610-63f91d7ae4ef tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "DELETE /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8/os-volume_attachments/dcb4fd68-313e-4a04-9f51-03f6693fd993" status: 202 len: 0 microversion: 2.1 time: 0.470587 Apr 30 13:19:21.023940 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 224/399] 10.222.0.79 () {58 vars in 1416 bytes} [Fri Apr 30 13:19:20 2021] DELETE /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8/os-volume_attachments/dcb4fd68-313e-4a04-9f51-03f6693fd993 => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 13:19:21.244004 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-86f0dff4-8d58-44ec-92bc-a56589da99cc tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:21.252985 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-4ee17dd7-072a-40fd-9488-4ae6790cafd0 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:21.254408 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-4ee17dd7-072a-40fd-9488-4ae6790cafd0 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 7fde42c1-2604-43e4-a825-3c3e3b38ca92] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:21.260509 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-86f0dff4-8d58-44ec-92bc-a56589da99cc tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:21.264179 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4ee17dd7-072a-40fd-9488-4ae6790cafd0 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:21.264479 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-86f0dff4-8d58-44ec-92bc-a56589da99cc tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:21.265232 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4ee17dd7-072a-40fd-9488-4ae6790cafd0 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:21.266281 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4ee17dd7-072a-40fd-9488-4ae6790cafd0 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:21.266872 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4ee17dd7-072a-40fd-9488-4ae6790cafd0 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:21.267225 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-86f0dff4-8d58-44ec-92bc-a56589da99cc tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1742 microversion: 2.20 time: 0.316628 Apr 30 13:19:21.277382 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 176/400] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:19:20 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1742 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:19:21.414913 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-4ee17dd7-072a-40fd-9488-4ae6790cafd0 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc9375be240416da7db978d32bd5531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079985bd0cc444091cb61ab2418c9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:21.432024 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-4ee17dd7-072a-40fd-9488-4ae6790cafd0 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] 10.222.0.79 "GET /compute/v2.1/servers/7fde42c1-2604-43e4-a825-3c3e3b38ca92" status: 200 len: 1266 microversion: 2.1 time: 0.182510 Apr 30 13:19:21.433485 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 225/401] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:21 2021] GET /compute/v2.1/servers/7fde42c1-2604-43e4-a825-3c3e3b38ca92 => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:19:22.297704 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-3ca79756-4801-4f65-ae8e-f05c08657d18 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:22.298546 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-3ca79756-4801-4f65-ae8e-f05c08657d18 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:22.317443 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3ca79756-4801-4f65-ae8e-f05c08657d18 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:22.317776 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3ca79756-4801-4f65-ae8e-f05c08657d18 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:22.318942 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3ca79756-4801-4f65-ae8e-f05c08657d18 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:22.319394 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3ca79756-4801-4f65-ae8e-f05c08657d18 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:22.463565 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-ef3d7c84-39cd-43c7-b573-dab18422e481 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:22.466093 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-ef3d7c84-39cd-43c7-b573-dab18422e481 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 7fde42c1-2604-43e4-a825-3c3e3b38ca92] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:22.478366 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ef3d7c84-39cd-43c7-b573-dab18422e481 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:22.479496 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ef3d7c84-39cd-43c7-b573-dab18422e481 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:22.480573 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ef3d7c84-39cd-43c7-b573-dab18422e481 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:22.481230 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ef3d7c84-39cd-43c7-b573-dab18422e481 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:22.640957 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-ef3d7c84-39cd-43c7-b573-dab18422e481 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc9375be240416da7db978d32bd5531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079985bd0cc444091cb61ab2418c9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:22.641499 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-ef3d7c84-39cd-43c7-b573-dab18422e481 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] 10.222.0.79 "GET /compute/v2.1/servers/7fde42c1-2604-43e4-a825-3c3e3b38ca92" status: 200 len: 1272 microversion: 2.1 time: 0.181246 Apr 30 13:19:22.645208 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 226/402] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:22 2021] GET /compute/v2.1/servers/7fde42c1-2604-43e4-a825-3c3e3b38ca92 => generated 1272 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:22.921896 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-3ca79756-4801-4f65-ae8e-f05c08657d18 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:22.938283 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-3ca79756-4801-4f65-ae8e-f05c08657d18 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:22.940484 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-3ca79756-4801-4f65-ae8e-f05c08657d18 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:22.942024 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-3ca79756-4801-4f65-ae8e-f05c08657d18 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1742 microversion: 2.20 time: 0.648185 Apr 30 13:19:22.944353 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 177/403] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:19:22 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1742 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:19:23.303337 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [req-f1f12d9e-9886-4316-a650-a534ae144b1c req-95c29103-f180-4878-a8b5-b8ff3ad36d23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad3419a7-71af-4a52-bcb7-6048e0553df9", "name": "network-vif-plugged", "status": "completed", "tag": "d3c715c3-b0fe-400d-89f5-80c09379ea24"}]} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:19:23.305741 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:19:23.305741 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: warnings.warn(msg) Apr 30 13:19:23.316395 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-f1f12d9e-9886-4316-a650-a534ae144b1c req-95c29103-f180-4878-a8b5-b8ff3ad36d23 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:23.317084 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-f1f12d9e-9886-4316-a650-a534ae144b1c req-95c29103-f180-4878-a8b5-b8ff3ad36d23 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:23.341845 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.compute.server_external_events [req-f1f12d9e-9886-4316-a650-a534ae144b1c req-95c29103-f180-4878-a8b5-b8ff3ad36d23 service nova] Creating event network-vif-plugged:d3c715c3-b0fe-400d-89f5-80c09379ea24 for instance ad3419a7-71af-4a52-bcb7-6048e0553df9 on hv-cinder-78836 Apr 30 13:19:23.351557 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [req-f1f12d9e-9886-4316-a650-a534ae144b1c req-95c29103-f180-4878-a8b5-b8ff3ad36d23 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052620 Apr 30 13:19:23.352933 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 227/404] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:19:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:19:23.672090 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-6b1e6458-d984-4eae-991e-e8d7c8521f17 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:23.672718 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-6b1e6458-d984-4eae-991e-e8d7c8521f17 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 7fde42c1-2604-43e4-a825-3c3e3b38ca92] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:23.685385 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6b1e6458-d984-4eae-991e-e8d7c8521f17 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:23.686276 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6b1e6458-d984-4eae-991e-e8d7c8521f17 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:23.687244 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6b1e6458-d984-4eae-991e-e8d7c8521f17 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:23.687962 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6b1e6458-d984-4eae-991e-e8d7c8521f17 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:23.966285 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-dfcf8324-469d-4871-ba05-066a693595cc tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:23.967105 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-dfcf8324-469d-4871-ba05-066a693595cc tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:23.987904 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-dfcf8324-469d-4871-ba05-066a693595cc tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:23.988608 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-dfcf8324-469d-4871-ba05-066a693595cc tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:23.989735 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-dfcf8324-469d-4871-ba05-066a693595cc tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:23.990443 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-dfcf8324-469d-4871-ba05-066a693595cc tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:24.342823 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-6b1e6458-d984-4eae-991e-e8d7c8521f17 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc9375be240416da7db978d32bd5531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079985bd0cc444091cb61ab2418c9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:24.355146 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-6b1e6458-d984-4eae-991e-e8d7c8521f17 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] 10.222.0.79 "GET /compute/v2.1/servers/7fde42c1-2604-43e4-a825-3c3e3b38ca92" status: 200 len: 1314 microversion: 2.1 time: 0.692157 Apr 30 13:19:24.356789 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 178/405] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:23 2021] GET /compute/v2.1/servers/7fde42c1-2604-43e4-a825-3c3e3b38ca92 => generated 1314 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:24.431965 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-dfcf8324-469d-4871-ba05-066a693595cc tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:24.476874 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-dfcf8324-469d-4871-ba05-066a693595cc tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:24.479518 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-dfcf8324-469d-4871-ba05-066a693595cc tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:24.481195 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-dfcf8324-469d-4871-ba05-066a693595cc tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1737 microversion: 2.20 time: 0.521510 Apr 30 13:19:24.481998 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 228/406] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:19:23 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1737 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:19:25.182586 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [req-6c72739d-1949-475a-b32b-47d7e1857d56 req-de467e7b-8ad2-4858-a774-d29a23014c72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fde42c1-2604-43e4-a825-3c3e3b38ca92", "tag": "f299c824-9028-418d-b885-93adef3af4f1"}]} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:19:25.193312 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:19:25.193312 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: warnings.warn(msg) Apr 30 13:19:25.242858 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-6c72739d-1949-475a-b32b-47d7e1857d56 req-de467e7b-8ad2-4858-a774-d29a23014c72 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:25.243608 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-6c72739d-1949-475a-b32b-47d7e1857d56 req-de467e7b-8ad2-4858-a774-d29a23014c72 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:25.283365 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.compute.server_external_events [req-6c72739d-1949-475a-b32b-47d7e1857d56 req-de467e7b-8ad2-4858-a774-d29a23014c72 service nova] Creating event network-changed:f299c824-9028-418d-b885-93adef3af4f1 for instance 7fde42c1-2604-43e4-a825-3c3e3b38ca92 on hv-cinder-78836 Apr 30 13:19:25.296503 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [req-6c72739d-1949-475a-b32b-47d7e1857d56 req-de467e7b-8ad2-4858-a774-d29a23014c72 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139782 Apr 30 13:19:25.304070 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 179/407] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:19:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:19:25.375604 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-acb39ca8-d57f-4cc9-82fc-c8188200d367 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:25.377142 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-acb39ca8-d57f-4cc9-82fc-c8188200d367 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 7fde42c1-2604-43e4-a825-3c3e3b38ca92] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:25.406423 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-acb39ca8-d57f-4cc9-82fc-c8188200d367 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:25.407111 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-acb39ca8-d57f-4cc9-82fc-c8188200d367 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:25.411409 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-acb39ca8-d57f-4cc9-82fc-c8188200d367 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:25.412962 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-acb39ca8-d57f-4cc9-82fc-c8188200d367 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:25.512137 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-92a0808e-37d9-47fb-801c-a6ea9c149fed tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:25.513254 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-92a0808e-37d9-47fb-801c-a6ea9c149fed tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:25.541350 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-92a0808e-37d9-47fb-801c-a6ea9c149fed tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:25.547033 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-92a0808e-37d9-47fb-801c-a6ea9c149fed tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:25.553350 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-92a0808e-37d9-47fb-801c-a6ea9c149fed tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:25.555441 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-92a0808e-37d9-47fb-801c-a6ea9c149fed tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:26.119996 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-acb39ca8-d57f-4cc9-82fc-c8188200d367 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc9375be240416da7db978d32bd5531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079985bd0cc444091cb61ab2418c9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:26.140594 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-acb39ca8-d57f-4cc9-82fc-c8188200d367 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] 10.222.0.79 "GET /compute/v2.1/servers/7fde42c1-2604-43e4-a825-3c3e3b38ca92" status: 200 len: 1314 microversion: 2.1 time: 0.769296 Apr 30 13:19:26.155764 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 229/408] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:25 2021] GET /compute/v2.1/servers/7fde42c1-2604-43e4-a825-3c3e3b38ca92 => generated 1314 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:19:26.467665 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-92a0808e-37d9-47fb-801c-a6ea9c149fed tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:26.486507 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-92a0808e-37d9-47fb-801c-a6ea9c149fed tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:26.488671 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-92a0808e-37d9-47fb-801c-a6ea9c149fed tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:26.492124 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-92a0808e-37d9-47fb-801c-a6ea9c149fed tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1737 microversion: 2.20 time: 0.989928 Apr 30 13:19:26.494646 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 180/409] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:19:25 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1737 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:19:27.170041 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-d024808e-b5f8-42f8-b1ce-0d0bbf83bfd3 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:27.170962 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-d024808e-b5f8-42f8-b1ce-0d0bbf83bfd3 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 7fde42c1-2604-43e4-a825-3c3e3b38ca92] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:27.191439 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d024808e-b5f8-42f8-b1ce-0d0bbf83bfd3 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:27.194647 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d024808e-b5f8-42f8-b1ce-0d0bbf83bfd3 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:27.195509 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d024808e-b5f8-42f8-b1ce-0d0bbf83bfd3 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:27.197767 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d024808e-b5f8-42f8-b1ce-0d0bbf83bfd3 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:27.514732 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-3775a6e8-c921-4d10-a57a-a5802b84bff3 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:27.515409 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-3775a6e8-c921-4d10-a57a-a5802b84bff3 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:27.531395 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3775a6e8-c921-4d10-a57a-a5802b84bff3 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:27.531855 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3775a6e8-c921-4d10-a57a-a5802b84bff3 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:27.532669 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3775a6e8-c921-4d10-a57a-a5802b84bff3 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:27.533116 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3775a6e8-c921-4d10-a57a-a5802b84bff3 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:27.927814 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-d024808e-b5f8-42f8-b1ce-0d0bbf83bfd3 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc9375be240416da7db978d32bd5531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079985bd0cc444091cb61ab2418c9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:27.947685 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-d024808e-b5f8-42f8-b1ce-0d0bbf83bfd3 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] 10.222.0.79 "GET /compute/v2.1/servers/7fde42c1-2604-43e4-a825-3c3e3b38ca92" status: 200 len: 1314 microversion: 2.1 time: 0.778410 Apr 30 13:19:27.949338 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 230/410] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:27 2021] GET /compute/v2.1/servers/7fde42c1-2604-43e4-a825-3c3e3b38ca92 => generated 1314 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:28.149684 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-4bde4c1b-8814-46c1-8526-4f6635e37780 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:19:28.151287 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-4bde4c1b-8814-46c1-8526-4f6635e37780 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:28.165366 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4bde4c1b-8814-46c1-8526-4f6635e37780 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:28.170482 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4bde4c1b-8814-46c1-8526-4f6635e37780 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:28.172594 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4bde4c1b-8814-46c1-8526-4f6635e37780 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:28.173280 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4bde4c1b-8814-46c1-8526-4f6635e37780 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:28.365542 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.objects.instance [None req-4bde4c1b-8814-46c1-8526-4f6635e37780 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lazy-loading 'flavor' on Instance uuid aa7277ee-287a-481c-a0e8-ae4dc4053a0e {{(pid=87933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:19:28.465466 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-3775a6e8-c921-4d10-a57a-a5802b84bff3 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:28.489552 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-3775a6e8-c921-4d10-a57a-a5802b84bff3 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:28.491657 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-3775a6e8-c921-4d10-a57a-a5802b84bff3 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:28.493492 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-3775a6e8-c921-4d10-a57a-a5802b84bff3 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1737 microversion: 2.20 time: 0.982842 Apr 30 13:19:28.494248 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 181/411] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:19:27 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1737 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:19:28.965203 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-2cb16133-9315-4b2d-8b39-4d3f1941d3ba tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:28.966050 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-2cb16133-9315-4b2d-8b39-4d3f1941d3ba tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 7fde42c1-2604-43e4-a825-3c3e3b38ca92] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:28.979261 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2cb16133-9315-4b2d-8b39-4d3f1941d3ba tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:28.979994 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2cb16133-9315-4b2d-8b39-4d3f1941d3ba tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:28.982076 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2cb16133-9315-4b2d-8b39-4d3f1941d3ba tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:28.991219 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2cb16133-9315-4b2d-8b39-4d3f1941d3ba tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:29.055029 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-4bde4c1b-8814-46c1-8526-4f6635e37780 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "POST /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e/action" status: 200 len: 32 microversion: 2.1 time: 0.910385 Apr 30 13:19:29.079148 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 231/412] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:19:28 2021] POST /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e/action => generated 32 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 30 13:19:29.096325 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-effcca85-4499-4c2a-8f6c-e65828b9abf5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:29.098636 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-effcca85-4499-4c2a-8f6c-e65828b9abf5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:29.112058 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-effcca85-4499-4c2a-8f6c-e65828b9abf5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:29.113442 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-effcca85-4499-4c2a-8f6c-e65828b9abf5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:29.116080 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-effcca85-4499-4c2a-8f6c-e65828b9abf5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:29.116995 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-effcca85-4499-4c2a-8f6c-e65828b9abf5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:29.414741 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-effcca85-4499-4c2a-8f6c-e65828b9abf5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:29.428292 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-effcca85-4499-4c2a-8f6c-e65828b9abf5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1566 microversion: 2.1 time: 0.345723 Apr 30 13:19:29.429627 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 232/413] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:29 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1566 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:29.516694 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-9ea33fb1-ddd5-46af-8e20-17006014849d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:29.517451 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-9ea33fb1-ddd5-46af-8e20-17006014849d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:29.537681 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9ea33fb1-ddd5-46af-8e20-17006014849d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:29.540521 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9ea33fb1-ddd5-46af-8e20-17006014849d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:29.544898 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9ea33fb1-ddd5-46af-8e20-17006014849d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:29.545679 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9ea33fb1-ddd5-46af-8e20-17006014849d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:29.634800 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-2cb16133-9315-4b2d-8b39-4d3f1941d3ba tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc9375be240416da7db978d32bd5531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079985bd0cc444091cb61ab2418c9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:29.662224 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-2cb16133-9315-4b2d-8b39-4d3f1941d3ba tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] 10.222.0.79 "GET /compute/v2.1/servers/7fde42c1-2604-43e4-a825-3c3e3b38ca92" status: 200 len: 1314 microversion: 2.1 time: 0.699885 Apr 30 13:19:29.668322 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 182/414] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:28 2021] GET /compute/v2.1/servers/7fde42c1-2604-43e4-a825-3c3e3b38ca92 => generated 1314 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:30.217538 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-9ea33fb1-ddd5-46af-8e20-17006014849d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:30.241152 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-9ea33fb1-ddd5-46af-8e20-17006014849d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:30.243264 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-9ea33fb1-ddd5-46af-8e20-17006014849d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:30.245045 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-9ea33fb1-ddd5-46af-8e20-17006014849d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1737 microversion: 2.20 time: 0.735371 Apr 30 13:19:30.260570 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 233/415] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:19:29 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1737 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:19:30.446384 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-d59b377e-249c-438f-bfae-67bf4433829b tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-922050236", "imageRef": "705a0c6b-b003-4687-84bf-8b9f87dae39e", "flavorRef": "452", "networks": [{"uuid": "4f6ff428-220c-464d-bf3c-450653cf4660"}]}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:19:30.453474 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-28dc2e0d-bee9-4a70-90f2-d0ceece6a969 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:30.455219 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-28dc2e0d-bee9-4a70-90f2-d0ceece6a969 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:30.478946 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-28dc2e0d-bee9-4a70-90f2-d0ceece6a969 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:30.480567 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-28dc2e0d-bee9-4a70-90f2-d0ceece6a969 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:30.481536 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-28dc2e0d-bee9-4a70-90f2-d0ceece6a969 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:30.482221 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-28dc2e0d-bee9-4a70-90f2-d0ceece6a969 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:30.721281 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-28dc2e0d-bee9-4a70-90f2-d0ceece6a969 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:30.732149 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-28dc2e0d-bee9-4a70-90f2-d0ceece6a969 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1566 microversion: 2.1 time: 0.284086 Apr 30 13:19:30.732739 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 234/416] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:30 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1566 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:19:30.737764 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-5c19f639-e3f3-4d4c-8196-0b47fac79c3e tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:30.738845 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-5c19f639-e3f3-4d4c-8196-0b47fac79c3e tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 7fde42c1-2604-43e4-a825-3c3e3b38ca92] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:30.747805 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5c19f639-e3f3-4d4c-8196-0b47fac79c3e tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:30.748266 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5c19f639-e3f3-4d4c-8196-0b47fac79c3e tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:30.749080 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5c19f639-e3f3-4d4c-8196-0b47fac79c3e tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:30.749526 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5c19f639-e3f3-4d4c-8196-0b47fac79c3e tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:31.005161 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-5c19f639-e3f3-4d4c-8196-0b47fac79c3e tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc9375be240416da7db978d32bd5531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079985bd0cc444091cb61ab2418c9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:31.014002 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-5c19f639-e3f3-4d4c-8196-0b47fac79c3e tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] 10.222.0.79 "GET /compute/v2.1/servers/7fde42c1-2604-43e4-a825-3c3e3b38ca92" status: 200 len: 1314 microversion: 2.1 time: 0.280233 Apr 30 13:19:31.024449 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 235/417] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:30 2021] GET /compute/v2.1/servers/7fde42c1-2604-43e4-a825-3c3e3b38ca92 => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:31.266315 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-11efa73e-afac-4278-8a4a-79886933f065 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:31.267261 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-11efa73e-afac-4278-8a4a-79886933f065 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:31.276451 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-11efa73e-afac-4278-8a4a-79886933f065 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:31.276656 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-11efa73e-afac-4278-8a4a-79886933f065 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:31.278202 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-11efa73e-afac-4278-8a4a-79886933f065 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:31.278554 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-11efa73e-afac-4278-8a4a-79886933f065 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:31.596739 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-11efa73e-afac-4278-8a4a-79886933f065 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:31.607856 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-11efa73e-afac-4278-8a4a-79886933f065 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:31.610765 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-11efa73e-afac-4278-8a4a-79886933f065 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:31.613368 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-11efa73e-afac-4278-8a4a-79886933f065 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1737 microversion: 2.20 time: 0.350686 Apr 30 13:19:31.614866 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 236/418] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:19:31 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1737 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:19:31.756367 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b4c95ee7-3759-4e16-b908-d0863a5897d9 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:31.756992 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-b4c95ee7-3759-4e16-b908-d0863a5897d9 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:31.765923 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b4c95ee7-3759-4e16-b908-d0863a5897d9 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:31.766433 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b4c95ee7-3759-4e16-b908-d0863a5897d9 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:31.767244 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b4c95ee7-3759-4e16-b908-d0863a5897d9 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:31.767701 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b4c95ee7-3759-4e16-b908-d0863a5897d9 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:32.040137 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-b4c95ee7-3759-4e16-b908-d0863a5897d9 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:32.056924 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b4c95ee7-3759-4e16-b908-d0863a5897d9 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1566 microversion: 2.1 time: 0.306736 Apr 30 13:19:32.058301 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 237/419] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:31 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1566 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:32.075157 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-28c434de-d587-40ed-84af-ca63f959c41e tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:32.077898 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-28c434de-d587-40ed-84af-ca63f959c41e tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 7fde42c1-2604-43e4-a825-3c3e3b38ca92] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:32.093386 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-28c434de-d587-40ed-84af-ca63f959c41e tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:32.093644 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-28c434de-d587-40ed-84af-ca63f959c41e tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:32.094971 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-28c434de-d587-40ed-84af-ca63f959c41e tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:32.096582 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-28c434de-d587-40ed-84af-ca63f959c41e tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:32.406322 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-28c434de-d587-40ed-84af-ca63f959c41e tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc9375be240416da7db978d32bd5531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079985bd0cc444091cb61ab2418c9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:32.430202 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-28c434de-d587-40ed-84af-ca63f959c41e tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] 10.222.0.79 "GET /compute/v2.1/servers/7fde42c1-2604-43e4-a825-3c3e3b38ca92" status: 200 len: 1314 microversion: 2.1 time: 0.360583 Apr 30 13:19:32.431473 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 238/420] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:32 2021] GET /compute/v2.1/servers/7fde42c1-2604-43e4-a825-3c3e3b38ca92 => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:32.634405 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-5564f0bc-e381-474c-bfa5-ab647506a789 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:32.635069 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-5564f0bc-e381-474c-bfa5-ab647506a789 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:32.648164 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5564f0bc-e381-474c-bfa5-ab647506a789 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:32.649214 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5564f0bc-e381-474c-bfa5-ab647506a789 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:32.650083 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5564f0bc-e381-474c-bfa5-ab647506a789 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:32.650544 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5564f0bc-e381-474c-bfa5-ab647506a789 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:32.922316 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-5564f0bc-e381-474c-bfa5-ab647506a789 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:32.933179 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-5564f0bc-e381-474c-bfa5-ab647506a789 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:32.935333 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-5564f0bc-e381-474c-bfa5-ab647506a789 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:32.937077 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-5564f0bc-e381-474c-bfa5-ab647506a789 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1737 microversion: 2.20 time: 0.306634 Apr 30 13:19:32.948701 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 239/421] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:19:32 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1737 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:19:33.083504 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-bfa7bfb0-cb41-465f-9032-193eb76b1ab0 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:33.084709 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-bfa7bfb0-cb41-465f-9032-193eb76b1ab0 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:33.104230 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-bfa7bfb0-cb41-465f-9032-193eb76b1ab0 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:33.105030 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-bfa7bfb0-cb41-465f-9032-193eb76b1ab0 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:33.109535 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-bfa7bfb0-cb41-465f-9032-193eb76b1ab0 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:33.110407 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-bfa7bfb0-cb41-465f-9032-193eb76b1ab0 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:33.421288 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-bfa7bfb0-cb41-465f-9032-193eb76b1ab0 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:33.434996 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-bfa7bfb0-cb41-465f-9032-193eb76b1ab0 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1566 microversion: 2.1 time: 0.359906 Apr 30 13:19:33.435840 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 240/422] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:33 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1566 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:33.455717 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-9cf4e94d-f380-40f6-942a-fa677df440ef tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:33.456737 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-9cf4e94d-f380-40f6-942a-fa677df440ef tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 7fde42c1-2604-43e4-a825-3c3e3b38ca92] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:33.465538 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9cf4e94d-f380-40f6-942a-fa677df440ef tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:33.466430 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9cf4e94d-f380-40f6-942a-fa677df440ef tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:33.467486 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9cf4e94d-f380-40f6-942a-fa677df440ef tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:33.468163 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9cf4e94d-f380-40f6-942a-fa677df440ef tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:33.804785 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-9cf4e94d-f380-40f6-942a-fa677df440ef tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc9375be240416da7db978d32bd5531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079985bd0cc444091cb61ab2418c9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:33.842345 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-9cf4e94d-f380-40f6-942a-fa677df440ef tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] 10.222.0.79 "GET /compute/v2.1/servers/7fde42c1-2604-43e4-a825-3c3e3b38ca92" status: 200 len: 1314 microversion: 2.1 time: 0.390231 Apr 30 13:19:33.843337 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 241/423] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:33 2021] GET /compute/v2.1/servers/7fde42c1-2604-43e4-a825-3c3e3b38ca92 => generated 1314 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:19:33.960040 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-d75f0111-f7f5-44c2-9d77-ab080d75f201 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:33.961061 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-d75f0111-f7f5-44c2-9d77-ab080d75f201 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:33.975368 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d75f0111-f7f5-44c2-9d77-ab080d75f201 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:33.976207 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d75f0111-f7f5-44c2-9d77-ab080d75f201 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:33.977254 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d75f0111-f7f5-44c2-9d77-ab080d75f201 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:33.978142 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d75f0111-f7f5-44c2-9d77-ab080d75f201 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:34.240122 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-d75f0111-f7f5-44c2-9d77-ab080d75f201 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:34.250547 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-d75f0111-f7f5-44c2-9d77-ab080d75f201 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:34.252102 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-d75f0111-f7f5-44c2-9d77-ab080d75f201 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:34.253261 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-d75f0111-f7f5-44c2-9d77-ab080d75f201 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1737 microversion: 2.20 time: 0.298222 Apr 30 13:19:34.254147 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 242/424] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:19:33 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1737 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:19:34.461162 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-0a46fd2f-97de-4f6f-956a-a7cfd38a3680 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:34.461929 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-0a46fd2f-97de-4f6f-956a-a7cfd38a3680 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:34.470856 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0a46fd2f-97de-4f6f-956a-a7cfd38a3680 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:34.471437 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0a46fd2f-97de-4f6f-956a-a7cfd38a3680 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:34.472329 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0a46fd2f-97de-4f6f-956a-a7cfd38a3680 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:34.473973 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0a46fd2f-97de-4f6f-956a-a7cfd38a3680 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:34.805488 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-0a46fd2f-97de-4f6f-956a-a7cfd38a3680 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:34.815338 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-0a46fd2f-97de-4f6f-956a-a7cfd38a3680 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1566 microversion: 2.1 time: 0.359042 Apr 30 13:19:34.826258 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 243/425] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:34 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1566 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:34.877637 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b623e25b-6bd2-4518-ae75-b5bd6e2f2dce tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:34.882101 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-b623e25b-6bd2-4518-ae75-b5bd6e2f2dce tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 7fde42c1-2604-43e4-a825-3c3e3b38ca92] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:34.898586 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b623e25b-6bd2-4518-ae75-b5bd6e2f2dce tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:34.899148 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b623e25b-6bd2-4518-ae75-b5bd6e2f2dce tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:34.900049 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b623e25b-6bd2-4518-ae75-b5bd6e2f2dce tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:34.900589 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b623e25b-6bd2-4518-ae75-b5bd6e2f2dce tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:35.290540 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-b623e25b-6bd2-4518-ae75-b5bd6e2f2dce tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc9375be240416da7db978d32bd5531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079985bd0cc444091cb61ab2418c9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:35.301574 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b623e25b-6bd2-4518-ae75-b5bd6e2f2dce tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] 10.222.0.79 "GET /compute/v2.1/servers/7fde42c1-2604-43e4-a825-3c3e3b38ca92" status: 200 len: 1314 microversion: 2.1 time: 0.437483 Apr 30 13:19:35.303740 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 244/426] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:34 2021] GET /compute/v2.1/servers/7fde42c1-2604-43e4-a825-3c3e3b38ca92 => generated 1314 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:35.310172 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-7673509d-ebf6-4261-970b-97f8d9c54970 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:35.311000 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-7673509d-ebf6-4261-970b-97f8d9c54970 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:35.328240 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7673509d-ebf6-4261-970b-97f8d9c54970 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:35.328786 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7673509d-ebf6-4261-970b-97f8d9c54970 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:35.329801 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7673509d-ebf6-4261-970b-97f8d9c54970 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:35.330277 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7673509d-ebf6-4261-970b-97f8d9c54970 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:35.677156 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-7673509d-ebf6-4261-970b-97f8d9c54970 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:35.689366 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-7673509d-ebf6-4261-970b-97f8d9c54970 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:35.691446 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-7673509d-ebf6-4261-970b-97f8d9c54970 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:35.693435 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-7673509d-ebf6-4261-970b-97f8d9c54970 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1737 microversion: 2.20 time: 0.388427 Apr 30 13:19:35.706784 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 245/427] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:19:35 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1737 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:19:35.813755 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [req-60b763f8-172d-4f96-9797-bad4042d5f42 req-2f993762-3e00-45df-88fe-bbcf52110e44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fde42c1-2604-43e4-a825-3c3e3b38ca92", "name": "network-vif-plugged", "status": "completed", "tag": "f299c824-9028-418d-b885-93adef3af4f1"}]} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:19:35.819664 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:19:35.819664 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: warnings.warn(msg) Apr 30 13:19:35.838631 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-60b763f8-172d-4f96-9797-bad4042d5f42 req-2f993762-3e00-45df-88fe-bbcf52110e44 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:35.839604 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-60b763f8-172d-4f96-9797-bad4042d5f42 req-2f993762-3e00-45df-88fe-bbcf52110e44 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:35.885817 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.compute.server_external_events [req-60b763f8-172d-4f96-9797-bad4042d5f42 req-2f993762-3e00-45df-88fe-bbcf52110e44 service nova] Creating event network-vif-plugged:f299c824-9028-418d-b885-93adef3af4f1 for instance 7fde42c1-2604-43e4-a825-3c3e3b38ca92 on hv-cinder-78836 Apr 30 13:19:35.906516 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [req-60b763f8-172d-4f96-9797-bad4042d5f42 req-2f993762-3e00-45df-88fe-bbcf52110e44 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114395 Apr 30 13:19:35.908040 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 246/428] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:19:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:19:35.933945 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-842582f5-3bc4-4843-9ebf-44fd2025e475 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:35.935607 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-842582f5-3bc4-4843-9ebf-44fd2025e475 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:35.952081 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-842582f5-3bc4-4843-9ebf-44fd2025e475 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:35.952864 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-842582f5-3bc4-4843-9ebf-44fd2025e475 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:35.954373 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-842582f5-3bc4-4843-9ebf-44fd2025e475 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:35.955170 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-842582f5-3bc4-4843-9ebf-44fd2025e475 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:36.503425 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-842582f5-3bc4-4843-9ebf-44fd2025e475 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:36.515209 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-842582f5-3bc4-4843-9ebf-44fd2025e475 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1566 microversion: 2.1 time: 0.602646 Apr 30 13:19:36.526902 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 247/429] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:35 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1566 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:36.548220 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-9429c109-c39c-4cb5-b8c5-b888bad7bf37 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:36.549955 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-9429c109-c39c-4cb5-b8c5-b888bad7bf37 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 7fde42c1-2604-43e4-a825-3c3e3b38ca92] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:36.561287 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9429c109-c39c-4cb5-b8c5-b888bad7bf37 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:36.562233 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9429c109-c39c-4cb5-b8c5-b888bad7bf37 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:36.563514 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9429c109-c39c-4cb5-b8c5-b888bad7bf37 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:36.564307 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9429c109-c39c-4cb5-b8c5-b888bad7bf37 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:36.970593 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-9429c109-c39c-4cb5-b8c5-b888bad7bf37 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc9375be240416da7db978d32bd5531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079985bd0cc444091cb61ab2418c9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:36.982788 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-9429c109-c39c-4cb5-b8c5-b888bad7bf37 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] 10.222.0.79 "GET /compute/v2.1/servers/7fde42c1-2604-43e4-a825-3c3e3b38ca92" status: 200 len: 1314 microversion: 2.1 time: 0.447820 Apr 30 13:19:36.983748 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 248/430] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:36 2021] GET /compute/v2.1/servers/7fde42c1-2604-43e4-a825-3c3e3b38ca92 => generated 1314 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:36.997700 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-3730aedf-942b-4eb0-a851-88be7e82ec04 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:36.998564 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-3730aedf-942b-4eb0-a851-88be7e82ec04 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:37.008622 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3730aedf-942b-4eb0-a851-88be7e82ec04 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:37.009775 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3730aedf-942b-4eb0-a851-88be7e82ec04 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:37.010050 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3730aedf-942b-4eb0-a851-88be7e82ec04 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:37.011290 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3730aedf-942b-4eb0-a851-88be7e82ec04 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:37.335662 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-3730aedf-942b-4eb0-a851-88be7e82ec04 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:37.371476 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-3730aedf-942b-4eb0-a851-88be7e82ec04 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:37.373506 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-3730aedf-942b-4eb0-a851-88be7e82ec04 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:37.374841 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-3730aedf-942b-4eb0-a851-88be7e82ec04 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1737 microversion: 2.20 time: 0.386529 Apr 30 13:19:37.375431 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 249/431] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:19:36 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1737 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:19:37.540168 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-4ac6953e-f403-4295-b5e7-2d20c7c2f935 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:37.540437 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-4ac6953e-f403-4295-b5e7-2d20c7c2f935 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:37.553932 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4ac6953e-f403-4295-b5e7-2d20c7c2f935 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:37.553932 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4ac6953e-f403-4295-b5e7-2d20c7c2f935 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:37.553932 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4ac6953e-f403-4295-b5e7-2d20c7c2f935 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:37.553932 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4ac6953e-f403-4295-b5e7-2d20c7c2f935 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:37.815920 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-4ac6953e-f403-4295-b5e7-2d20c7c2f935 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:37.827038 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-4ac6953e-f403-4295-b5e7-2d20c7c2f935 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1566 microversion: 2.1 time: 0.292100 Apr 30 13:19:37.828475 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 250/432] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:37 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1566 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:37.828615 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.network.neutron [None req-d59b377e-249c-438f-bfae-67bf4433829b tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] validate_networks() for [('4f6ff428-220c-464d-bf3c-450653cf4660', None, None, None)] {{(pid=87932) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 13:19:38.005290 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-4e2f3fdb-68b8-4783-933c-7d365ac3f75c tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:38.006290 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-4e2f3fdb-68b8-4783-933c-7d365ac3f75c tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 7fde42c1-2604-43e4-a825-3c3e3b38ca92] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:38.024297 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4e2f3fdb-68b8-4783-933c-7d365ac3f75c tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:38.025092 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4e2f3fdb-68b8-4783-933c-7d365ac3f75c tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:38.026262 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4e2f3fdb-68b8-4783-933c-7d365ac3f75c tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:38.026977 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4e2f3fdb-68b8-4783-933c-7d365ac3f75c tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:38.462180 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-4e2f3fdb-68b8-4783-933c-7d365ac3f75c tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc9375be240416da7db978d32bd5531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079985bd0cc444091cb61ab2418c9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:38.476389 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-4e2f3fdb-68b8-4783-933c-7d365ac3f75c tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] 10.222.0.79 "GET /compute/v2.1/servers/7fde42c1-2604-43e4-a825-3c3e3b38ca92" status: 200 len: 1314 microversion: 2.1 time: 0.472840 Apr 30 13:19:38.476389 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 251/433] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:37 2021] GET /compute/v2.1/servers/7fde42c1-2604-43e4-a825-3c3e3b38ca92 => generated 1314 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:19:38.479749 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-6fd4d3e5-4d1b-49e4-9567-6d8d10632191 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:38.480375 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-6fd4d3e5-4d1b-49e4-9567-6d8d10632191 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:38.488387 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6fd4d3e5-4d1b-49e4-9567-6d8d10632191 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:38.489421 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6fd4d3e5-4d1b-49e4-9567-6d8d10632191 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:38.490231 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6fd4d3e5-4d1b-49e4-9567-6d8d10632191 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:38.490693 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6fd4d3e5-4d1b-49e4-9567-6d8d10632191 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:38.752046 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-6fd4d3e5-4d1b-49e4-9567-6d8d10632191 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:38.768635 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-6fd4d3e5-4d1b-49e4-9567-6d8d10632191 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:38.771100 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-6fd4d3e5-4d1b-49e4-9567-6d8d10632191 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:38.772958 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-6fd4d3e5-4d1b-49e4-9567-6d8d10632191 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1737 microversion: 2.20 time: 0.297196 Apr 30 13:19:38.787804 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 252/434] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:19:38 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1737 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:19:38.814058 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-d59b377e-249c-438f-bfae-67bf4433829b tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Flavor limits 0:0:0 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 13:19:38.814718 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-d59b377e-249c-438f-bfae-67bf4433829b tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Image limits 0:0:0 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 13:19:38.815370 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-d59b377e-249c-438f-bfae-67bf4433829b tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Flavor pref 0:0:0 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 13:19:38.816156 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-d59b377e-249c-438f-bfae-67bf4433829b tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Image pref 0:0:0 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 13:19:38.816581 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-d59b377e-249c-438f-bfae-67bf4433829b tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 13:19:38.828551 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d59b377e-249c-438f-bfae-67bf4433829b tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:38.829721 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d59b377e-249c-438f-bfae-67bf4433829b tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:38.831342 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d59b377e-249c-438f-bfae-67bf4433829b tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:38.832074 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d59b377e-249c-438f-bfae-67bf4433829b tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:38.845405 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-85321e3e-31aa-4933-8bac-f6e20e8c3d67 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:38.846058 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-85321e3e-31aa-4933-8bac-f6e20e8c3d67 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:38.861615 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-85321e3e-31aa-4933-8bac-f6e20e8c3d67 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:38.862388 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-85321e3e-31aa-4933-8bac-f6e20e8c3d67 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:38.863322 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-85321e3e-31aa-4933-8bac-f6e20e8c3d67 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:38.863946 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-85321e3e-31aa-4933-8bac-f6e20e8c3d67 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:38.868356 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.quota [None req-d59b377e-249c-438f-bfae-67bf4433829b tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Getting quotas for project f8dcaa02d735401891147a4c2464e318. Resources: {'ram', 'instances', 'cores'} {{(pid=87932) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:19:38.874378 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.quota [None req-d59b377e-249c-438f-bfae-67bf4433829b tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Getting quotas for user f2a53be36b2d4d6681dacffb5843510f and project f8dcaa02d735401891147a4c2464e318. Resources: {'ram', 'instances', 'cores'} {{(pid=87932) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:19:38.889299 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-d59b377e-249c-438f-bfae-67bf4433829b tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Going to run 1 instances... {{(pid=87932) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 13:19:38.891931 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-d59b377e-249c-438f-bfae-67bf4433829b tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 1a6ccbb4-3ad3-4ffa-b205-32968e961896] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='705a0c6b-b003-4687-84bf-8b9f87dae39e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=87932) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 13:19:38.967721 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-d59b377e-249c-438f-bfae-67bf4433829b tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.527274 Apr 30 13:19:38.973774 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 183/435] 10.222.0.79 () {60 vars in 1147 bytes} [Fri Apr 30 13:19:30 2021] POST /compute/v2.1/servers => generated 380 bytes in 8529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 13:19:38.982706 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-67caecc6-4a23-4abd-a3f9-09efe8e80811 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:38.983481 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-67caecc6-4a23-4abd-a3f9-09efe8e80811 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 1a6ccbb4-3ad3-4ffa-b205-32968e961896] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:39.121855 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-67caecc6-4a23-4abd-a3f9-09efe8e80811 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:39.140951 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-67caecc6-4a23-4abd-a3f9-09efe8e80811 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/1a6ccbb4-3ad3-4ffa-b205-32968e961896" status: 200 len: 1217 microversion: 2.1 time: 0.162454 Apr 30 13:19:39.140951 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 184/436] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:38 2021] GET /compute/v2.1/servers/1a6ccbb4-3ad3-4ffa-b205-32968e961896 => generated 1217 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:19:39.209466 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-85321e3e-31aa-4933-8bac-f6e20e8c3d67 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:39.221985 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-85321e3e-31aa-4933-8bac-f6e20e8c3d67 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1566 microversion: 2.1 time: 0.380335 Apr 30 13:19:39.226735 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 253/437] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:38 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1566 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:39.509213 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-3c015c3f-7e35-4643-8dfb-457e003b37fc tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:39.510047 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-3c015c3f-7e35-4643-8dfb-457e003b37fc tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 7fde42c1-2604-43e4-a825-3c3e3b38ca92] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:39.526301 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3c015c3f-7e35-4643-8dfb-457e003b37fc tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:39.526985 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3c015c3f-7e35-4643-8dfb-457e003b37fc tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:39.528085 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3c015c3f-7e35-4643-8dfb-457e003b37fc tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:39.528739 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3c015c3f-7e35-4643-8dfb-457e003b37fc tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:39.813035 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b77e640c-0ce9-4eea-acb3-958b9fa92f8d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:39.814307 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-b77e640c-0ce9-4eea-acb3-958b9fa92f8d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:39.836314 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b77e640c-0ce9-4eea-acb3-958b9fa92f8d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:39.837542 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b77e640c-0ce9-4eea-acb3-958b9fa92f8d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:39.839355 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b77e640c-0ce9-4eea-acb3-958b9fa92f8d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:39.844774 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b77e640c-0ce9-4eea-acb3-958b9fa92f8d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:40.071344 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-3c015c3f-7e35-4643-8dfb-457e003b37fc tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc9375be240416da7db978d32bd5531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079985bd0cc444091cb61ab2418c9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:40.083971 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-3c015c3f-7e35-4643-8dfb-457e003b37fc tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] 10.222.0.79 "GET /compute/v2.1/servers/7fde42c1-2604-43e4-a825-3c3e3b38ca92" status: 200 len: 1497 microversion: 2.1 time: 0.580158 Apr 30 13:19:40.087313 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 185/438] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:39 2021] GET /compute/v2.1/servers/7fde42c1-2604-43e4-a825-3c3e3b38ca92 => generated 1497 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:40.155948 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-a29f3d28-548f-4c6c-b5e3-242a70b9e40c tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:40.157151 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-a29f3d28-548f-4c6c-b5e3-242a70b9e40c tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 1a6ccbb4-3ad3-4ffa-b205-32968e961896] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:40.170218 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a29f3d28-548f-4c6c-b5e3-242a70b9e40c tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:40.175252 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a29f3d28-548f-4c6c-b5e3-242a70b9e40c tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:40.178865 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a29f3d28-548f-4c6c-b5e3-242a70b9e40c tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:40.185384 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a29f3d28-548f-4c6c-b5e3-242a70b9e40c tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:40.459208 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-b77e640c-0ce9-4eea-acb3-958b9fa92f8d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:40.476113 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-b77e640c-0ce9-4eea-acb3-958b9fa92f8d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:40.478672 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-b77e640c-0ce9-4eea-acb3-958b9fa92f8d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:40.480323 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b77e640c-0ce9-4eea-acb3-958b9fa92f8d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1719 microversion: 2.20 time: 0.689112 Apr 30 13:19:40.486184 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 254/439] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:19:39 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1719 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:19:40.490923 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-46c66a14-6ae0-46ad-b2c1-799a88ba09f5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:40.499936 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-46c66a14-6ae0-46ad-b2c1-799a88ba09f5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:40.511137 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-a29f3d28-548f-4c6c-b5e3-242a70b9e40c tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:40.525182 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-46c66a14-6ae0-46ad-b2c1-799a88ba09f5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:40.525647 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-46c66a14-6ae0-46ad-b2c1-799a88ba09f5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:40.526648 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-46c66a14-6ae0-46ad-b2c1-799a88ba09f5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:40.526992 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-46c66a14-6ae0-46ad-b2c1-799a88ba09f5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:40.527166 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-a29f3d28-548f-4c6c-b5e3-242a70b9e40c tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/1a6ccbb4-3ad3-4ffa-b205-32968e961896" status: 200 len: 1213 microversion: 2.1 time: 0.375000 Apr 30 13:19:40.529561 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 186/440] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:40 2021] GET /compute/v2.1/servers/1a6ccbb4-3ad3-4ffa-b205-32968e961896 => generated 1213 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:19:40.813427 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-46c66a14-6ae0-46ad-b2c1-799a88ba09f5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:40.823432 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-46c66a14-6ae0-46ad-b2c1-799a88ba09f5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1566 microversion: 2.1 time: 0.340621 Apr 30 13:19:40.824020 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 255/441] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:40 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1566 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:41.509797 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-fdad2827-2094-4955-ba78-d8199e563acf tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:41.517603 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-fdad2827-2094-4955-ba78-d8199e563acf tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:41.551336 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-870570ba-955d-4cdd-8c53-d4d84a7f419c tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:41.553231 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-870570ba-955d-4cdd-8c53-d4d84a7f419c tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 1a6ccbb4-3ad3-4ffa-b205-32968e961896] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:41.565278 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fdad2827-2094-4955-ba78-d8199e563acf tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:41.566188 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fdad2827-2094-4955-ba78-d8199e563acf tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:41.567769 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fdad2827-2094-4955-ba78-d8199e563acf tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:41.568653 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fdad2827-2094-4955-ba78-d8199e563acf tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:41.580086 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-870570ba-955d-4cdd-8c53-d4d84a7f419c tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:41.580852 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-870570ba-955d-4cdd-8c53-d4d84a7f419c tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:41.598711 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-870570ba-955d-4cdd-8c53-d4d84a7f419c tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:41.599799 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-870570ba-955d-4cdd-8c53-d4d84a7f419c tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:41.927654 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-870570ba-955d-4cdd-8c53-d4d84a7f419c tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:41.939344 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-870570ba-955d-4cdd-8c53-d4d84a7f419c tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/1a6ccbb4-3ad3-4ffa-b205-32968e961896" status: 200 len: 1275 microversion: 2.1 time: 0.396167 Apr 30 13:19:41.945963 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 256/442] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:41 2021] GET /compute/v2.1/servers/1a6ccbb4-3ad3-4ffa-b205-32968e961896 => generated 1275 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:41.951402 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [req-f5a45c04-a31d-4c2e-80a5-a1170a22ab90 req-984c9997-f056-4c92-82ba-16cdaf92bfa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad3419a7-71af-4a52-bcb7-6048e0553df9", "name": "network-vif-unplugged", "status": "completed", "tag": "d3c715c3-b0fe-400d-89f5-80c09379ea24"}]} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:19:41.956255 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:19:41.956255 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: warnings.warn(msg) Apr 30 13:19:41.988395 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-f5a45c04-a31d-4c2e-80a5-a1170a22ab90 req-984c9997-f056-4c92-82ba-16cdaf92bfa5 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:41.990975 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-f5a45c04-a31d-4c2e-80a5-a1170a22ab90 req-984c9997-f056-4c92-82ba-16cdaf92bfa5 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:42.013542 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.compute.server_external_events [req-f5a45c04-a31d-4c2e-80a5-a1170a22ab90 req-984c9997-f056-4c92-82ba-16cdaf92bfa5 service nova] Creating event network-vif-unplugged:d3c715c3-b0fe-400d-89f5-80c09379ea24 for instance ad3419a7-71af-4a52-bcb7-6048e0553df9 on hv-cinder-78836 Apr 30 13:19:42.018530 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [req-f5a45c04-a31d-4c2e-80a5-a1170a22ab90 req-984c9997-f056-4c92-82ba-16cdaf92bfa5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070991 Apr 30 13:19:42.019490 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 257/443] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:19:41 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:19:42.025203 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-cbe90952-6936-4502-9214-5c6782f5e160 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:42.026071 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-cbe90952-6936-4502-9214-5c6782f5e160 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:42.034925 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-cbe90952-6936-4502-9214-5c6782f5e160 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:42.035925 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-cbe90952-6936-4502-9214-5c6782f5e160 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:42.036989 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-cbe90952-6936-4502-9214-5c6782f5e160 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:42.037525 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-cbe90952-6936-4502-9214-5c6782f5e160 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:42.150603 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-fdad2827-2094-4955-ba78-d8199e563acf tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:42.177189 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-fdad2827-2094-4955-ba78-d8199e563acf tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:42.181477 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-fdad2827-2094-4955-ba78-d8199e563acf tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:42.184416 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-fdad2827-2094-4955-ba78-d8199e563acf tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1719 microversion: 2.20 time: 0.681715 Apr 30 13:19:42.186505 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 187/444] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:19:41 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1719 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:19:42.314332 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-cbe90952-6936-4502-9214-5c6782f5e160 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:42.325432 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-cbe90952-6936-4502-9214-5c6782f5e160 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1566 microversion: 2.1 time: 0.304531 Apr 30 13:19:42.326046 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 258/445] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:42 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1566 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:42.963767 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-c713444b-0ca0-49f7-a7b9-419689fef24f tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:42.964934 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-c713444b-0ca0-49f7-a7b9-419689fef24f tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 1a6ccbb4-3ad3-4ffa-b205-32968e961896] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:42.972585 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c713444b-0ca0-49f7-a7b9-419689fef24f tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:42.973634 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c713444b-0ca0-49f7-a7b9-419689fef24f tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:42.974583 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c713444b-0ca0-49f7-a7b9-419689fef24f tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:42.974970 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c713444b-0ca0-49f7-a7b9-419689fef24f tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:43.206546 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-0d0ec6b1-245b-4a6d-99d9-fd72bb8b772a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:43.207210 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-0d0ec6b1-245b-4a6d-99d9-fd72bb8b772a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:43.216242 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0d0ec6b1-245b-4a6d-99d9-fd72bb8b772a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:43.216795 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0d0ec6b1-245b-4a6d-99d9-fd72bb8b772a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:43.217865 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0d0ec6b1-245b-4a6d-99d9-fd72bb8b772a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:43.218495 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0d0ec6b1-245b-4a6d-99d9-fd72bb8b772a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:43.220837 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-c713444b-0ca0-49f7-a7b9-419689fef24f tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:43.231034 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-c713444b-0ca0-49f7-a7b9-419689fef24f tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/1a6ccbb4-3ad3-4ffa-b205-32968e961896" status: 200 len: 1317 microversion: 2.1 time: 0.271697 Apr 30 13:19:43.232234 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 188/446] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:42 2021] GET /compute/v2.1/servers/1a6ccbb4-3ad3-4ffa-b205-32968e961896 => generated 1317 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:43.343844 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-56dd7aa0-f8f3-48c9-a177-e0892524ccbb tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:43.345017 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-56dd7aa0-f8f3-48c9-a177-e0892524ccbb tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:43.354757 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-56dd7aa0-f8f3-48c9-a177-e0892524ccbb tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:43.355512 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-56dd7aa0-f8f3-48c9-a177-e0892524ccbb tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:43.356537 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-56dd7aa0-f8f3-48c9-a177-e0892524ccbb tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:43.357146 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-56dd7aa0-f8f3-48c9-a177-e0892524ccbb tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:43.428986 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-0d0ec6b1-245b-4a6d-99d9-fd72bb8b772a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:43.440910 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-0d0ec6b1-245b-4a6d-99d9-fd72bb8b772a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:43.443391 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-0d0ec6b1-245b-4a6d-99d9-fd72bb8b772a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:43.444896 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-0d0ec6b1-245b-4a6d-99d9-fd72bb8b772a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1719 microversion: 2.20 time: 0.242047 Apr 30 13:19:43.445583 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 259/447] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:19:43 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1719 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:19:43.569833 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-56dd7aa0-f8f3-48c9-a177-e0892524ccbb tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:43.580770 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-56dd7aa0-f8f3-48c9-a177-e0892524ccbb tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1566 microversion: 2.1 time: 0.240967 Apr 30 13:19:43.581350 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 189/448] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:43 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1566 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:19:44.250063 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-d6c0b0ed-607a-47ad-b334-6eecc12f4d10 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:44.250721 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-d6c0b0ed-607a-47ad-b334-6eecc12f4d10 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 1a6ccbb4-3ad3-4ffa-b205-32968e961896] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:44.259603 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d6c0b0ed-607a-47ad-b334-6eecc12f4d10 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:44.260070 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d6c0b0ed-607a-47ad-b334-6eecc12f4d10 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:44.260879 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d6c0b0ed-607a-47ad-b334-6eecc12f4d10 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:44.261356 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d6c0b0ed-607a-47ad-b334-6eecc12f4d10 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:44.472398 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-1318ea3a-b738-4ea4-a6ec-cba88d13812f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:44.474890 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-1318ea3a-b738-4ea4-a6ec-cba88d13812f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:44.492313 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1318ea3a-b738-4ea4-a6ec-cba88d13812f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:44.493304 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1318ea3a-b738-4ea4-a6ec-cba88d13812f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:44.494708 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1318ea3a-b738-4ea4-a6ec-cba88d13812f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:44.495450 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1318ea3a-b738-4ea4-a6ec-cba88d13812f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:44.592151 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-d6c0b0ed-607a-47ad-b334-6eecc12f4d10 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:44.603602 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-d6c0b0ed-607a-47ad-b334-6eecc12f4d10 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/1a6ccbb4-3ad3-4ffa-b205-32968e961896" status: 200 len: 1317 microversion: 2.1 time: 0.357255 Apr 30 13:19:44.604256 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 260/449] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:44 2021] GET /compute/v2.1/servers/1a6ccbb4-3ad3-4ffa-b205-32968e961896 => generated 1317 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:44.609379 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-c5173fe4-7616-475c-835d-4ff52319817d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:44.610186 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-c5173fe4-7616-475c-835d-4ff52319817d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:44.618772 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c5173fe4-7616-475c-835d-4ff52319817d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:44.619229 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c5173fe4-7616-475c-835d-4ff52319817d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:44.620060 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c5173fe4-7616-475c-835d-4ff52319817d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:44.620496 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c5173fe4-7616-475c-835d-4ff52319817d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:44.750486 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-1318ea3a-b738-4ea4-a6ec-cba88d13812f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:44.762651 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-1318ea3a-b738-4ea4-a6ec-cba88d13812f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:44.764220 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-1318ea3a-b738-4ea4-a6ec-cba88d13812f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:44.765460 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-1318ea3a-b738-4ea4-a6ec-cba88d13812f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1719 microversion: 2.20 time: 0.303953 Apr 30 13:19:44.766050 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 190/450] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:19:44 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1719 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:19:44.919974 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-c5173fe4-7616-475c-835d-4ff52319817d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:44.930743 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-c5173fe4-7616-475c-835d-4ff52319817d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1566 microversion: 2.1 time: 0.325208 Apr 30 13:19:44.931360 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 261/451] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:44 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1566 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:45.624746 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-c66fd98c-eb1f-48d4-a915-390f9b48c650 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:45.625369 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-c66fd98c-eb1f-48d4-a915-390f9b48c650 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 1a6ccbb4-3ad3-4ffa-b205-32968e961896] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:45.633893 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c66fd98c-eb1f-48d4-a915-390f9b48c650 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:45.634393 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c66fd98c-eb1f-48d4-a915-390f9b48c650 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:45.635303 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c66fd98c-eb1f-48d4-a915-390f9b48c650 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:45.635746 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c66fd98c-eb1f-48d4-a915-390f9b48c650 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:45.738258 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-908ccfdf-82d0-4c65-a827-d70908ae83f3 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:45.740015 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-908ccfdf-82d0-4c65-a827-d70908ae83f3 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 7fde42c1-2604-43e4-a825-3c3e3b38ca92] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:45.747697 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-908ccfdf-82d0-4c65-a827-d70908ae83f3 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:45.748375 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-908ccfdf-82d0-4c65-a827-d70908ae83f3 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:45.749139 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-908ccfdf-82d0-4c65-a827-d70908ae83f3 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:45.749606 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-908ccfdf-82d0-4c65-a827-d70908ae83f3 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:45.819406 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-908ccfdf-82d0-4c65-a827-d70908ae83f3 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 7fde42c1-2604-43e4-a825-3c3e3b38ca92] Going to try to terminate instance {{(pid=87933) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 13:19:46.006853 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-908ccfdf-82d0-4c65-a827-d70908ae83f3 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] 10.222.0.79 "DELETE /compute/v2.1/servers/7fde42c1-2604-43e4-a825-3c3e3b38ca92" status: 204 len: 0 microversion: 2.1 time: 0.271849 Apr 30 13:19:46.009046 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 262/452] 10.222.0.79 () {58 vars in 1239 bytes} [Fri Apr 30 13:19:45 2021] DELETE /compute/v2.1/servers/7fde42c1-2604-43e4-a825-3c3e3b38ca92 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 30 13:19:46.020578 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b974909a-a2b7-4a2c-971b-231c43630fdd tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:46.022818 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-b974909a-a2b7-4a2c-971b-231c43630fdd tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:46.040737 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b974909a-a2b7-4a2c-971b-231c43630fdd tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:46.041924 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b974909a-a2b7-4a2c-971b-231c43630fdd tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:46.043928 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b974909a-a2b7-4a2c-971b-231c43630fdd tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:46.045203 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b974909a-a2b7-4a2c-971b-231c43630fdd tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:46.311749 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-c66fd98c-eb1f-48d4-a915-390f9b48c650 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:46.336605 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-c66fd98c-eb1f-48d4-a915-390f9b48c650 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/1a6ccbb4-3ad3-4ffa-b205-32968e961896" status: 200 len: 1317 microversion: 2.1 time: 0.717304 Apr 30 13:19:46.339239 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 191/453] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:45 2021] GET /compute/v2.1/servers/1a6ccbb4-3ad3-4ffa-b205-32968e961896 => generated 1317 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:46.354703 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-7bc8919d-5165-4cd3-86d9-360bd04fa382 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:46.358708 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-7bc8919d-5165-4cd3-86d9-360bd04fa382 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:46.374155 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-b974909a-a2b7-4a2c-971b-231c43630fdd tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:46.384967 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7bc8919d-5165-4cd3-86d9-360bd04fa382 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:46.386236 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7bc8919d-5165-4cd3-86d9-360bd04fa382 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:46.387357 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7bc8919d-5165-4cd3-86d9-360bd04fa382 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:46.388002 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7bc8919d-5165-4cd3-86d9-360bd04fa382 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:46.396058 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-b974909a-a2b7-4a2c-971b-231c43630fdd tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:46.400275 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-b974909a-a2b7-4a2c-971b-231c43630fdd tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:46.403063 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b974909a-a2b7-4a2c-971b-231c43630fdd tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1719 microversion: 2.20 time: 0.391536 Apr 30 13:19:46.404674 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 263/454] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:19:46 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1719 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:19:46.420122 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-55b83f39-b9b9-46e7-b703-4bdeb2df7059 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:46.421179 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-55b83f39-b9b9-46e7-b703-4bdeb2df7059 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 7fde42c1-2604-43e4-a825-3c3e3b38ca92] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:46.431581 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-55b83f39-b9b9-46e7-b703-4bdeb2df7059 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:46.432032 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-55b83f39-b9b9-46e7-b703-4bdeb2df7059 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:46.433264 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-55b83f39-b9b9-46e7-b703-4bdeb2df7059 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:46.433628 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-55b83f39-b9b9-46e7-b703-4bdeb2df7059 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:46.683039 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-55b83f39-b9b9-46e7-b703-4bdeb2df7059 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc9375be240416da7db978d32bd5531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079985bd0cc444091cb61ab2418c9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:46.694463 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-55b83f39-b9b9-46e7-b703-4bdeb2df7059 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] 10.222.0.79 "GET /compute/v2.1/servers/7fde42c1-2604-43e4-a825-3c3e3b38ca92" status: 200 len: 1503 microversion: 2.1 time: 0.286218 Apr 30 13:19:46.694632 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 264/455] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:46 2021] GET /compute/v2.1/servers/7fde42c1-2604-43e4-a825-3c3e3b38ca92 => generated 1503 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:46.709309 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [req-5c0d153d-2ce2-4ec2-bfe2-6aeb6ce5ab5e req-58c36c4c-931b-4997-bf33-5f0506bb1488 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a6ccbb4-3ad3-4ffa-b205-32968e961896", "tag": "f5b457d3-15e2-4e12-a63e-4e6d1632b84c"}]} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:19:46.711872 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:19:46.711872 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: warnings.warn(msg) Apr 30 13:19:46.724224 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-5c0d153d-2ce2-4ec2-bfe2-6aeb6ce5ab5e req-58c36c4c-931b-4997-bf33-5f0506bb1488 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:46.725541 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-5c0d153d-2ce2-4ec2-bfe2-6aeb6ce5ab5e req-58c36c4c-931b-4997-bf33-5f0506bb1488 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:46.749212 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.compute.server_external_events [req-5c0d153d-2ce2-4ec2-bfe2-6aeb6ce5ab5e req-58c36c4c-931b-4997-bf33-5f0506bb1488 service nova] Creating event network-changed:f5b457d3-15e2-4e12-a63e-4e6d1632b84c for instance 1a6ccbb4-3ad3-4ffa-b205-32968e961896 on hv-cinder-78836 Apr 30 13:19:46.755148 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [req-5c0d153d-2ce2-4ec2-bfe2-6aeb6ce5ab5e req-58c36c4c-931b-4997-bf33-5f0506bb1488 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058460 Apr 30 13:19:46.756179 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 265/456] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:19:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:19:46.901840 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-7bc8919d-5165-4cd3-86d9-360bd04fa382 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:46.912069 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-7bc8919d-5165-4cd3-86d9-360bd04fa382 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1566 microversion: 2.1 time: 0.569957 Apr 30 13:19:46.912664 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 192/457] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:46 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1566 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:47.356250 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-9af2a0a9-0738-4cac-a993-276711809e3a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:47.356991 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-9af2a0a9-0738-4cac-a993-276711809e3a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 1a6ccbb4-3ad3-4ffa-b205-32968e961896] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:47.371324 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9af2a0a9-0738-4cac-a993-276711809e3a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:47.371324 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9af2a0a9-0738-4cac-a993-276711809e3a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:47.371324 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9af2a0a9-0738-4cac-a993-276711809e3a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:47.371324 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9af2a0a9-0738-4cac-a993-276711809e3a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:47.427619 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-351bd347-85bd-466c-9ea7-e308520221bf tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:47.428674 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-351bd347-85bd-466c-9ea7-e308520221bf tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:47.453514 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-351bd347-85bd-466c-9ea7-e308520221bf tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:47.454763 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-351bd347-85bd-466c-9ea7-e308520221bf tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:47.457668 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-351bd347-85bd-466c-9ea7-e308520221bf tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:47.458781 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-351bd347-85bd-466c-9ea7-e308520221bf tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:47.676672 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-9af2a0a9-0738-4cac-a993-276711809e3a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:47.685321 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-9af2a0a9-0738-4cac-a993-276711809e3a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/1a6ccbb4-3ad3-4ffa-b205-32968e961896" status: 200 len: 1317 microversion: 2.1 time: 0.333078 Apr 30 13:19:47.685907 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 266/458] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:47 2021] GET /compute/v2.1/servers/1a6ccbb4-3ad3-4ffa-b205-32968e961896 => generated 1317 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:47.711540 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-5ac639b6-1e99-4ef3-9fdb-ad316fcd2788 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:47.712281 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-5ac639b6-1e99-4ef3-9fdb-ad316fcd2788 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 7fde42c1-2604-43e4-a825-3c3e3b38ca92] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:47.719868 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5ac639b6-1e99-4ef3-9fdb-ad316fcd2788 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:47.720422 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5ac639b6-1e99-4ef3-9fdb-ad316fcd2788 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:47.721302 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5ac639b6-1e99-4ef3-9fdb-ad316fcd2788 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:47.721829 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5ac639b6-1e99-4ef3-9fdb-ad316fcd2788 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:47.955644 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-5ac639b6-1e99-4ef3-9fdb-ad316fcd2788 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc9375be240416da7db978d32bd5531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079985bd0cc444091cb61ab2418c9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:47.966078 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-5ac639b6-1e99-4ef3-9fdb-ad316fcd2788 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] 10.222.0.79 "GET /compute/v2.1/servers/7fde42c1-2604-43e4-a825-3c3e3b38ca92" status: 200 len: 1503 microversion: 2.1 time: 0.258197 Apr 30 13:19:47.966677 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 267/459] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:47 2021] GET /compute/v2.1/servers/7fde42c1-2604-43e4-a825-3c3e3b38ca92 => generated 1503 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:19:47.972028 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-830c5c60-e583-4a7d-9f27-953475632323 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:47.972957 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-830c5c60-e583-4a7d-9f27-953475632323 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:47.982047 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-830c5c60-e583-4a7d-9f27-953475632323 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:47.982828 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-830c5c60-e583-4a7d-9f27-953475632323 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:47.983715 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-830c5c60-e583-4a7d-9f27-953475632323 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:47.984192 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-830c5c60-e583-4a7d-9f27-953475632323 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:48.128741 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-351bd347-85bd-466c-9ea7-e308520221bf tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:48.141787 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-351bd347-85bd-466c-9ea7-e308520221bf tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:48.143994 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-351bd347-85bd-466c-9ea7-e308520221bf tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:48.146398 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-351bd347-85bd-466c-9ea7-e308520221bf tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1719 microversion: 2.20 time: 0.722726 Apr 30 13:19:48.147050 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 193/460] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:19:47 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1719 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:19:48.215523 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-830c5c60-e583-4a7d-9f27-953475632323 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:48.224622 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-830c5c60-e583-4a7d-9f27-953475632323 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1566 microversion: 2.1 time: 0.256664 Apr 30 13:19:48.225215 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 268/461] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:47 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1566 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:48.702932 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-0f81c0d4-8a67-47a2-9c96-6e4203332e07 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:48.703724 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-0f81c0d4-8a67-47a2-9c96-6e4203332e07 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 1a6ccbb4-3ad3-4ffa-b205-32968e961896] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:48.712536 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0f81c0d4-8a67-47a2-9c96-6e4203332e07 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:48.713216 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0f81c0d4-8a67-47a2-9c96-6e4203332e07 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:48.714301 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0f81c0d4-8a67-47a2-9c96-6e4203332e07 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:48.714952 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0f81c0d4-8a67-47a2-9c96-6e4203332e07 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:48.987061 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-08e91445-d45d-4473-b7a1-cdbfeff00a3d tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:48.988120 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-08e91445-d45d-4473-b7a1-cdbfeff00a3d tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 7fde42c1-2604-43e4-a825-3c3e3b38ca92] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:49.008740 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-08e91445-d45d-4473-b7a1-cdbfeff00a3d tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:49.009257 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-08e91445-d45d-4473-b7a1-cdbfeff00a3d tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:49.010118 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-08e91445-d45d-4473-b7a1-cdbfeff00a3d tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:49.010560 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-08e91445-d45d-4473-b7a1-cdbfeff00a3d tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:49.098689 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-0f81c0d4-8a67-47a2-9c96-6e4203332e07 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:49.116229 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-0f81c0d4-8a67-47a2-9c96-6e4203332e07 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/1a6ccbb4-3ad3-4ffa-b205-32968e961896" status: 200 len: 1317 microversion: 2.1 time: 0.417038 Apr 30 13:19:49.125820 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 194/462] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:48 2021] GET /compute/v2.1/servers/1a6ccbb4-3ad3-4ffa-b205-32968e961896 => generated 1317 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:49.165981 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-ad28949e-7541-4a7f-a1df-bbf36febe3e6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:49.167035 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-ad28949e-7541-4a7f-a1df-bbf36febe3e6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:49.193727 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ad28949e-7541-4a7f-a1df-bbf36febe3e6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:49.196646 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ad28949e-7541-4a7f-a1df-bbf36febe3e6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:49.198563 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ad28949e-7541-4a7f-a1df-bbf36febe3e6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:49.199978 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ad28949e-7541-4a7f-a1df-bbf36febe3e6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:49.345520 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-08e91445-d45d-4473-b7a1-cdbfeff00a3d tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc9375be240416da7db978d32bd5531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079985bd0cc444091cb61ab2418c9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:49.364409 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-08e91445-d45d-4473-b7a1-cdbfeff00a3d tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] 10.222.0.79 "GET /compute/v2.1/servers/7fde42c1-2604-43e4-a825-3c3e3b38ca92" status: 200 len: 1503 microversion: 2.1 time: 0.384254 Apr 30 13:19:49.370327 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 269/463] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:48 2021] GET /compute/v2.1/servers/7fde42c1-2604-43e4-a825-3c3e3b38ca92 => generated 1503 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:49.376181 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-e32822ac-0b3c-41af-b919-7a1819bf2b6a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:49.377111 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-e32822ac-0b3c-41af-b919-7a1819bf2b6a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:49.389356 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e32822ac-0b3c-41af-b919-7a1819bf2b6a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:49.390157 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e32822ac-0b3c-41af-b919-7a1819bf2b6a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:49.391467 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e32822ac-0b3c-41af-b919-7a1819bf2b6a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:49.392215 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e32822ac-0b3c-41af-b919-7a1819bf2b6a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:49.737865 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-e32822ac-0b3c-41af-b919-7a1819bf2b6a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:49.747728 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-e32822ac-0b3c-41af-b919-7a1819bf2b6a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1566 microversion: 2.1 time: 0.375335 Apr 30 13:19:49.748326 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 270/464] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:49 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1566 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:49.800396 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-ad28949e-7541-4a7f-a1df-bbf36febe3e6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:49.820016 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-ad28949e-7541-4a7f-a1df-bbf36febe3e6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:49.828041 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-ad28949e-7541-4a7f-a1df-bbf36febe3e6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:49.831423 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-ad28949e-7541-4a7f-a1df-bbf36febe3e6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1662 microversion: 2.20 time: 0.667129 Apr 30 13:19:49.834999 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 195/465] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:19:49 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1662 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:19:49.851277 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-a66a2ef1-e972-4701-a8b2-8eee9603031a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9021a8f8-b014-4bb9-af1d-f8c3df7a88bc"}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:19:49.853648 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-a66a2ef1-e972-4701-a8b2-8eee9603031a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:49.870256 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a66a2ef1-e972-4701-a8b2-8eee9603031a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:49.870759 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a66a2ef1-e972-4701-a8b2-8eee9603031a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:49.871588 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a66a2ef1-e972-4701-a8b2-8eee9603031a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:49.872481 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a66a2ef1-e972-4701-a8b2-8eee9603031a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:50.133469 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-81c995e1-220f-427a-81be-cacaefca4753 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:50.134142 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-81c995e1-220f-427a-81be-cacaefca4753 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 1a6ccbb4-3ad3-4ffa-b205-32968e961896] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:50.141807 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-81c995e1-220f-427a-81be-cacaefca4753 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:50.142313 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-81c995e1-220f-427a-81be-cacaefca4753 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:50.143170 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-81c995e1-220f-427a-81be-cacaefca4753 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:50.143556 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-81c995e1-220f-427a-81be-cacaefca4753 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:50.355426 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-a66a2ef1-e972-4701-a8b2-8eee9603031a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.508913 Apr 30 13:19:50.356973 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 271/466] 10.222.0.79 () {62 vars in 1364 bytes} [Fri Apr 30 13:19:49 2021] POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/os-volume_attachments => generated 188 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:19:50.383829 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-fad0dac8-4f23-4969-bd70-6ac973ca2306 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:50.385020 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-fad0dac8-4f23-4969-bd70-6ac973ca2306 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 7fde42c1-2604-43e4-a825-3c3e3b38ca92] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:50.398782 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-fad0dac8-4f23-4969-bd70-6ac973ca2306 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:50.399033 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-fad0dac8-4f23-4969-bd70-6ac973ca2306 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:50.400090 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-fad0dac8-4f23-4969-bd70-6ac973ca2306 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:50.400590 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-fad0dac8-4f23-4969-bd70-6ac973ca2306 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:50.575085 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-81c995e1-220f-427a-81be-cacaefca4753 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:50.584471 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-81c995e1-220f-427a-81be-cacaefca4753 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/1a6ccbb4-3ad3-4ffa-b205-32968e961896" status: 200 len: 1317 microversion: 2.1 time: 0.455375 Apr 30 13:19:50.585224 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 196/467] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:50 2021] GET /compute/v2.1/servers/1a6ccbb4-3ad3-4ffa-b205-32968e961896 => generated 1317 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:50.592504 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-268e8a33-d96a-43fb-a974-6c062fa7c9a2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:19:50.593607 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-268e8a33-d96a-43fb-a974-6c062fa7c9a2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:50.605550 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-268e8a33-d96a-43fb-a974-6c062fa7c9a2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:50.606042 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-268e8a33-d96a-43fb-a974-6c062fa7c9a2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:50.607130 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-268e8a33-d96a-43fb-a974-6c062fa7c9a2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:50.607745 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-268e8a33-d96a-43fb-a974-6c062fa7c9a2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:50.649313 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-fad0dac8-4f23-4969-bd70-6ac973ca2306 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc9375be240416da7db978d32bd5531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079985bd0cc444091cb61ab2418c9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:50.658437 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-fad0dac8-4f23-4969-bd70-6ac973ca2306 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] 10.222.0.79 "GET /compute/v2.1/servers/7fde42c1-2604-43e4-a825-3c3e3b38ca92" status: 200 len: 1503 microversion: 2.1 time: 0.279194 Apr 30 13:19:50.659140 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 272/468] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:50 2021] GET /compute/v2.1/servers/7fde42c1-2604-43e4-a825-3c3e3b38ca92 => generated 1503 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:50.771326 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-26b2d83d-f481-4406-a07c-2b7e6b106c6e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:50.772578 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-26b2d83d-f481-4406-a07c-2b7e6b106c6e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:50.784320 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-26b2d83d-f481-4406-a07c-2b7e6b106c6e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:50.785834 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-26b2d83d-f481-4406-a07c-2b7e6b106c6e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:50.787404 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-26b2d83d-f481-4406-a07c-2b7e6b106c6e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:50.788063 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-26b2d83d-f481-4406-a07c-2b7e6b106c6e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:50.788590 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-268e8a33-d96a-43fb-a974-6c062fa7c9a2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action" status: 202 len: 0 microversion: 2.20 time: 0.201882 Apr 30 13:19:50.790261 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 197/469] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:19:50 2021] POST /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 30 13:19:50.826277 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-deb569d2-3665-477d-8521-6b439a737972 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:50.826557 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-deb569d2-3665-477d-8521-6b439a737972 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:50.854784 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-deb569d2-3665-477d-8521-6b439a737972 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:50.855921 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-deb569d2-3665-477d-8521-6b439a737972 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:50.861702 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-deb569d2-3665-477d-8521-6b439a737972 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:50.864879 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-deb569d2-3665-477d-8521-6b439a737972 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:51.124050 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-26b2d83d-f481-4406-a07c-2b7e6b106c6e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:51.139647 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-26b2d83d-f481-4406-a07c-2b7e6b106c6e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1566 microversion: 2.1 time: 0.376915 Apr 30 13:19:51.151170 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 273/470] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:50 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1566 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:51.392318 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-deb569d2-3665-477d-8521-6b439a737972 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:51.403529 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-deb569d2-3665-477d-8521-6b439a737972 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:51.405579 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-deb569d2-3665-477d-8521-6b439a737972 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:51.408070 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-deb569d2-3665-477d-8521-6b439a737972 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1748 microversion: 2.20 time: 0.600474 Apr 30 13:19:51.421947 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 198/471] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:19:50 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1748 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:19:51.603193 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-401b7738-9e7f-44d0-9fe3-94a584c7e8eb tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:51.603920 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-401b7738-9e7f-44d0-9fe3-94a584c7e8eb tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 1a6ccbb4-3ad3-4ffa-b205-32968e961896] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:51.613123 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-401b7738-9e7f-44d0-9fe3-94a584c7e8eb tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:51.614072 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-401b7738-9e7f-44d0-9fe3-94a584c7e8eb tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:51.615207 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-401b7738-9e7f-44d0-9fe3-94a584c7e8eb tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:51.615843 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-401b7738-9e7f-44d0-9fe3-94a584c7e8eb tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:51.636856 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [req-a19bf2eb-aa17-410c-a617-c29f4526d071 req-e28d3c22-2d9c-4fe9-b172-fa348224a43b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fde42c1-2604-43e4-a825-3c3e3b38ca92", "name": "network-vif-deleted", "tag": "f299c824-9028-418d-b885-93adef3af4f1"}]} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:19:51.638763 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:19:51.638763 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: warnings.warn(msg) Apr 30 13:19:51.653959 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-a19bf2eb-aa17-410c-a617-c29f4526d071 req-e28d3c22-2d9c-4fe9-b172-fa348224a43b service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:51.654443 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-a19bf2eb-aa17-410c-a617-c29f4526d071 req-e28d3c22-2d9c-4fe9-b172-fa348224a43b service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:51.674985 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.compute.server_external_events [req-a19bf2eb-aa17-410c-a617-c29f4526d071 req-e28d3c22-2d9c-4fe9-b172-fa348224a43b service nova] Creating event network-vif-deleted:f299c824-9028-418d-b885-93adef3af4f1 for instance 7fde42c1-2604-43e4-a825-3c3e3b38ca92 on hv-cinder-78836 Apr 30 13:19:51.683658 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [req-a19bf2eb-aa17-410c-a617-c29f4526d071 req-e28d3c22-2d9c-4fe9-b172-fa348224a43b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050539 Apr 30 13:19:51.688202 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 199/472] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:19:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:19:51.695383 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-196450e3-1338-445e-982e-315c79338bb4 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:51.696910 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-196450e3-1338-445e-982e-315c79338bb4 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 7fde42c1-2604-43e4-a825-3c3e3b38ca92] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:51.706297 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-196450e3-1338-445e-982e-315c79338bb4 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:51.707583 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-196450e3-1338-445e-982e-315c79338bb4 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:51.708839 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-196450e3-1338-445e-982e-315c79338bb4 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:51.709464 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-196450e3-1338-445e-982e-315c79338bb4 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:51.898069 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-196450e3-1338-445e-982e-315c79338bb4 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc9375be240416da7db978d32bd5531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079985bd0cc444091cb61ab2418c9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:51.906682 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-196450e3-1338-445e-982e-315c79338bb4 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] 10.222.0.79 "GET /compute/v2.1/servers/7fde42c1-2604-43e4-a825-3c3e3b38ca92" status: 200 len: 1299 microversion: 2.1 time: 0.217156 Apr 30 13:19:51.922112 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 200/473] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:51 2021] GET /compute/v2.1/servers/7fde42c1-2604-43e4-a825-3c3e3b38ca92 => generated 1299 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:52.141593 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-401b7738-9e7f-44d0-9fe3-94a584c7e8eb tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:52.155512 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-401b7738-9e7f-44d0-9fe3-94a584c7e8eb tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/1a6ccbb4-3ad3-4ffa-b205-32968e961896" status: 200 len: 1317 microversion: 2.1 time: 0.558046 Apr 30 13:19:52.159204 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-48afef4d-1bce-480c-8bb0-d99f8f322989 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:52.168223 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 274/474] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:51 2021] GET /compute/v2.1/servers/1a6ccbb4-3ad3-4ffa-b205-32968e961896 => generated 1317 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:52.170448 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-48afef4d-1bce-480c-8bb0-d99f8f322989 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:52.187112 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-48afef4d-1bce-480c-8bb0-d99f8f322989 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:52.189179 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-48afef4d-1bce-480c-8bb0-d99f8f322989 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:52.192022 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-48afef4d-1bce-480c-8bb0-d99f8f322989 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:52.193983 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-48afef4d-1bce-480c-8bb0-d99f8f322989 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:52.430878 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-eb0b4f68-72b3-4e60-86a0-5ff31ce09c5a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:52.431639 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-eb0b4f68-72b3-4e60-86a0-5ff31ce09c5a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:52.442654 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-eb0b4f68-72b3-4e60-86a0-5ff31ce09c5a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:52.443233 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-eb0b4f68-72b3-4e60-86a0-5ff31ce09c5a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:52.444466 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-eb0b4f68-72b3-4e60-86a0-5ff31ce09c5a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:52.444907 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-eb0b4f68-72b3-4e60-86a0-5ff31ce09c5a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:52.473302 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-48afef4d-1bce-480c-8bb0-d99f8f322989 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:52.492334 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-48afef4d-1bce-480c-8bb0-d99f8f322989 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1566 microversion: 2.1 time: 0.337905 Apr 30 13:19:52.492905 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 201/475] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:52 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1566 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:52.824662 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-eb0b4f68-72b3-4e60-86a0-5ff31ce09c5a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:52.835441 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-eb0b4f68-72b3-4e60-86a0-5ff31ce09c5a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:52.836976 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-eb0b4f68-72b3-4e60-86a0-5ff31ce09c5a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:52.838233 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-eb0b4f68-72b3-4e60-86a0-5ff31ce09c5a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1748 microversion: 2.20 time: 0.414239 Apr 30 13:19:52.839338 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 275/476] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:19:52 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1748 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:19:52.927617 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-b8140a98-0998-413c-9c85-f7f1486c3d5c tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:52.928305 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-b8140a98-0998-413c-9c85-f7f1486c3d5c tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 7fde42c1-2604-43e4-a825-3c3e3b38ca92] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:52.937197 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b8140a98-0998-413c-9c85-f7f1486c3d5c tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:52.937656 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b8140a98-0998-413c-9c85-f7f1486c3d5c tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:52.938507 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b8140a98-0998-413c-9c85-f7f1486c3d5c tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:52.938956 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b8140a98-0998-413c-9c85-f7f1486c3d5c tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:53.030564 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b8140a98-0998-413c-9c85-f7f1486c3d5c tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:53.031030 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b8140a98-0998-413c-9c85-f7f1486c3d5c tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:53.031489 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.objects.instance [None req-b8140a98-0998-413c-9c85-f7f1486c3d5c tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lazy-loading 'fault' on Instance uuid 7fde42c1-2604-43e4-a825-3c3e3b38ca92 {{(pid=87932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:19:53.137900 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-b8140a98-0998-413c-9c85-f7f1486c3d5c tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc9375be240416da7db978d32bd5531', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9079985bd0cc444091cb61ab2418c9a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:53.147345 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-b8140a98-0998-413c-9c85-f7f1486c3d5c tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] 10.222.0.79 "GET /compute/v2.1/servers/7fde42c1-2604-43e4-a825-3c3e3b38ca92" status: 200 len: 1304 microversion: 2.1 time: 0.224220 Apr 30 13:19:53.157768 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 202/477] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:52 2021] GET /compute/v2.1/servers/7fde42c1-2604-43e4-a825-3c3e3b38ca92 => generated 1304 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:53.177264 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-e686f629-d75e-49ab-88cb-576ce422420f tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:53.178945 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-e686f629-d75e-49ab-88cb-576ce422420f tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 1a6ccbb4-3ad3-4ffa-b205-32968e961896] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:53.188999 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e686f629-d75e-49ab-88cb-576ce422420f tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:53.189665 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e686f629-d75e-49ab-88cb-576ce422420f tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:53.190729 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e686f629-d75e-49ab-88cb-576ce422420f tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:53.191232 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e686f629-d75e-49ab-88cb-576ce422420f tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:53.455306 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-e686f629-d75e-49ab-88cb-576ce422420f tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:53.465643 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-e686f629-d75e-49ab-88cb-576ce422420f tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/1a6ccbb4-3ad3-4ffa-b205-32968e961896" status: 200 len: 1317 microversion: 2.1 time: 0.293500 Apr 30 13:19:53.466269 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 276/478] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:53 2021] GET /compute/v2.1/servers/1a6ccbb4-3ad3-4ffa-b205-32968e961896 => generated 1317 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:53.508811 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-78e878c5-11f4-4ff2-9dd4-367338d0162a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:53.509431 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-78e878c5-11f4-4ff2-9dd4-367338d0162a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:53.516883 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-78e878c5-11f4-4ff2-9dd4-367338d0162a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:53.517272 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-78e878c5-11f4-4ff2-9dd4-367338d0162a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:53.518108 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-78e878c5-11f4-4ff2-9dd4-367338d0162a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:53.518555 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-78e878c5-11f4-4ff2-9dd4-367338d0162a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:53.757707 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-78e878c5-11f4-4ff2-9dd4-367338d0162a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:53.767836 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-78e878c5-11f4-4ff2-9dd4-367338d0162a tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1566 microversion: 2.1 time: 0.262590 Apr 30 13:19:53.768761 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 203/479] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:53 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1566 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:53.857892 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-20bc5cde-b6aa-4855-a1cd-ef9063d59532 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:53.859218 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-20bc5cde-b6aa-4855-a1cd-ef9063d59532 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:53.869028 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-20bc5cde-b6aa-4855-a1cd-ef9063d59532 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:53.869608 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-20bc5cde-b6aa-4855-a1cd-ef9063d59532 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:53.871005 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-20bc5cde-b6aa-4855-a1cd-ef9063d59532 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:53.871894 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-20bc5cde-b6aa-4855-a1cd-ef9063d59532 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:54.153753 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-20bc5cde-b6aa-4855-a1cd-ef9063d59532 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:54.165558 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-1b8ec87e-c6de-40fa-8e4f-f708784d69a4 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:54.166769 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-1b8ec87e-c6de-40fa-8e4f-f708784d69a4 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] [instance: 7fde42c1-2604-43e4-a825-3c3e3b38ca92] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:54.177775 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-20bc5cde-b6aa-4855-a1cd-ef9063d59532 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:54.179032 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1b8ec87e-c6de-40fa-8e4f-f708784d69a4 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:54.179502 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1b8ec87e-c6de-40fa-8e4f-f708784d69a4 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:54.180517 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1b8ec87e-c6de-40fa-8e4f-f708784d69a4 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:54.181023 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-20bc5cde-b6aa-4855-a1cd-ef9063d59532 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:54.181513 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1b8ec87e-c6de-40fa-8e4f-f708784d69a4 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:54.183204 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-20bc5cde-b6aa-4855-a1cd-ef9063d59532 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1750 microversion: 2.20 time: 0.329581 Apr 30 13:19:54.184248 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 277/480] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:19:53 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1750 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:19:54.242933 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.wsgi [None req-1b8ec87e-c6de-40fa-8e4f-f708784d69a4 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] HTTP exception thrown: Instance 7fde42c1-2604-43e4-a825-3c3e3b38ca92 could not be found. Apr 30 13:19:54.243701 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-1b8ec87e-c6de-40fa-8e4f-f708784d69a4 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] Returning 404 to user: Instance 7fde42c1-2604-43e4-a825-3c3e3b38ca92 could not be found. {{(pid=87932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:19:54.244390 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-1b8ec87e-c6de-40fa-8e4f-f708784d69a4 tempest-VolumesActionsTest-1565703987 tempest-VolumesActionsTest-1565703987-project] 10.222.0.79 "GET /compute/v2.1/servers/7fde42c1-2604-43e4-a825-3c3e3b38ca92" status: 404 len: 111 microversion: 2.1 time: 0.082568 Apr 30 13:19:54.244950 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 204/481] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:54 2021] GET /compute/v2.1/servers/7fde42c1-2604-43e4-a825-3c3e3b38ca92 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 13:19:54.495206 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-0a36495e-a0fc-4c3e-81a4-c7ee0b54aeb0 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:54.501024 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-0a36495e-a0fc-4c3e-81a4-c7ee0b54aeb0 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 1a6ccbb4-3ad3-4ffa-b205-32968e961896] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:54.533355 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0a36495e-a0fc-4c3e-81a4-c7ee0b54aeb0 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:54.537236 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0a36495e-a0fc-4c3e-81a4-c7ee0b54aeb0 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:54.540675 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0a36495e-a0fc-4c3e-81a4-c7ee0b54aeb0 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:54.543202 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0a36495e-a0fc-4c3e-81a4-c7ee0b54aeb0 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:54.795517 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-4873d253-f2bf-4d3b-a61d-3b7b66729cf8 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:54.798708 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-4873d253-f2bf-4d3b-a61d-3b7b66729cf8 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:54.808797 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4873d253-f2bf-4d3b-a61d-3b7b66729cf8 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:54.810248 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4873d253-f2bf-4d3b-a61d-3b7b66729cf8 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:54.811643 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4873d253-f2bf-4d3b-a61d-3b7b66729cf8 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:54.812322 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4873d253-f2bf-4d3b-a61d-3b7b66729cf8 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:55.077668 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-0a36495e-a0fc-4c3e-81a4-c7ee0b54aeb0 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:55.089210 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-0a36495e-a0fc-4c3e-81a4-c7ee0b54aeb0 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/1a6ccbb4-3ad3-4ffa-b205-32968e961896" status: 200 len: 1317 microversion: 2.1 time: 0.605251 Apr 30 13:19:55.089905 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 278/482] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:54 2021] GET /compute/v2.1/servers/1a6ccbb4-3ad3-4ffa-b205-32968e961896 => generated 1317 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:19:55.207923 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-420ebb11-8741-4d94-ae63-1dd193572444 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:55.209029 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-420ebb11-8741-4d94-ae63-1dd193572444 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:55.233597 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-420ebb11-8741-4d94-ae63-1dd193572444 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:55.235021 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-420ebb11-8741-4d94-ae63-1dd193572444 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:55.236380 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-420ebb11-8741-4d94-ae63-1dd193572444 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:55.237131 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-420ebb11-8741-4d94-ae63-1dd193572444 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:55.292880 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-4873d253-f2bf-4d3b-a61d-3b7b66729cf8 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:55.321550 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-4873d253-f2bf-4d3b-a61d-3b7b66729cf8 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1566 microversion: 2.1 time: 0.532758 Apr 30 13:19:55.327934 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 205/483] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:54 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1566 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:55.707097 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-420ebb11-8741-4d94-ae63-1dd193572444 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:55.724155 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-420ebb11-8741-4d94-ae63-1dd193572444 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:55.728848 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-420ebb11-8741-4d94-ae63-1dd193572444 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:55.731860 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-420ebb11-8741-4d94-ae63-1dd193572444 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1750 microversion: 2.20 time: 0.530842 Apr 30 13:19:55.733327 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 279/484] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:19:55 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1750 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:19:55.789791 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-5479fb84-71f6-4b3e-9a86-89779b246c80 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6e375744-fffe-4616-ac31-900890d2691f", "device": "/dev/sdb"}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:19:55.791891 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-5479fb84-71f6-4b3e-9a86-89779b246c80 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: 8ae91590-af1f-473b-9391-f77fe37593f2] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:55.818533 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5479fb84-71f6-4b3e-9a86-89779b246c80 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:55.828158 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5479fb84-71f6-4b3e-9a86-89779b246c80 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:55.830549 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5479fb84-71f6-4b3e-9a86-89779b246c80 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:55.832419 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5479fb84-71f6-4b3e-9a86-89779b246c80 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:56.109399 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-d1b1b18d-ff2d-4e6a-9653-20a79c15433d tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:56.110470 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-d1b1b18d-ff2d-4e6a-9653-20a79c15433d tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 1a6ccbb4-3ad3-4ffa-b205-32968e961896] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:56.127691 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d1b1b18d-ff2d-4e6a-9653-20a79c15433d tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:56.130578 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d1b1b18d-ff2d-4e6a-9653-20a79c15433d tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:56.131582 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d1b1b18d-ff2d-4e6a-9653-20a79c15433d tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:56.132102 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d1b1b18d-ff2d-4e6a-9653-20a79c15433d tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:56.680863 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-d1b1b18d-ff2d-4e6a-9653-20a79c15433d tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:56.692731 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-d1b1b18d-ff2d-4e6a-9653-20a79c15433d tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/1a6ccbb4-3ad3-4ffa-b205-32968e961896" status: 200 len: 1317 microversion: 2.1 time: 0.588474 Apr 30 13:19:56.705603 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 280/485] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:56 2021] GET /compute/v2.1/servers/1a6ccbb4-3ad3-4ffa-b205-32968e961896 => generated 1317 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:19:56.717024 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-c97a0d15-920f-4903-9061-defcfdb913cb tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:56.717650 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-c97a0d15-920f-4903-9061-defcfdb913cb tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:56.737619 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c97a0d15-920f-4903-9061-defcfdb913cb tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:56.738245 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c97a0d15-920f-4903-9061-defcfdb913cb tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:56.738999 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c97a0d15-920f-4903-9061-defcfdb913cb tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:56.739443 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c97a0d15-920f-4903-9061-defcfdb913cb tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:56.866531 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-5479fb84-71f6-4b3e-9a86-89779b246c80 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "POST /compute/v2.1/servers/8ae91590-af1f-473b-9391-f77fe37593f2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.081144 Apr 30 13:19:56.872841 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 206/486] 10.222.0.79 () {60 vars in 1323 bytes} [Fri Apr 30 13:19:55 2021] POST /compute/v2.1/servers/8ae91590-af1f-473b-9391-f77fe37593f2/os-volume_attachments => generated 194 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:19:56.896319 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [req-ce4d347d-fb14-4334-82e8-934750007ddb req-70790579-d1c7-44f1-8c22-70cd0238001c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a6ccbb4-3ad3-4ffa-b205-32968e961896", "name": "network-vif-plugged", "status": "completed", "tag": "f5b457d3-15e2-4e12-a63e-4e6d1632b84c"}]} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:19:56.905903 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:19:56.905903 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: warnings.warn(msg) Apr 30 13:19:56.924877 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-ce4d347d-fb14-4334-82e8-934750007ddb req-70790579-d1c7-44f1-8c22-70cd0238001c service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:56.928172 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-ce4d347d-fb14-4334-82e8-934750007ddb req-70790579-d1c7-44f1-8c22-70cd0238001c service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:56.965426 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.compute.server_external_events [req-ce4d347d-fb14-4334-82e8-934750007ddb req-70790579-d1c7-44f1-8c22-70cd0238001c service nova] Creating event network-vif-plugged:f5b457d3-15e2-4e12-a63e-4e6d1632b84c for instance 1a6ccbb4-3ad3-4ffa-b205-32968e961896 on hv-cinder-78836 Apr 30 13:19:56.971781 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [req-ce4d347d-fb14-4334-82e8-934750007ddb req-70790579-d1c7-44f1-8c22-70cd0238001c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096780 Apr 30 13:19:56.972760 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 207/487] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:19:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:19:56.979037 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-cb5158b9-20ae-4711-9ffd-63485d4c6665 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:56.980450 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-cb5158b9-20ae-4711-9ffd-63485d4c6665 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:56.989771 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cb5158b9-20ae-4711-9ffd-63485d4c6665 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:56.990754 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cb5158b9-20ae-4711-9ffd-63485d4c6665 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:56.991998 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cb5158b9-20ae-4711-9ffd-63485d4c6665 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:56.992679 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cb5158b9-20ae-4711-9ffd-63485d4c6665 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:57.127415 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-c97a0d15-920f-4903-9061-defcfdb913cb tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:57.140226 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-c97a0d15-920f-4903-9061-defcfdb913cb tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1566 microversion: 2.1 time: 0.433419 Apr 30 13:19:57.151335 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 281/488] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:56 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1566 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:57.296777 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-cb5158b9-20ae-4711-9ffd-63485d4c6665 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:57.307894 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-cb5158b9-20ae-4711-9ffd-63485d4c6665 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:57.310290 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-cb5158b9-20ae-4711-9ffd-63485d4c6665 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:57.311656 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-cb5158b9-20ae-4711-9ffd-63485d4c6665 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1750 microversion: 2.20 time: 0.337576 Apr 30 13:19:57.312369 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 208/489] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:19:56 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1750 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:19:57.712404 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-e54df979-69d8-4d54-a67e-30d768028296 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:57.713344 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-e54df979-69d8-4d54-a67e-30d768028296 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 1a6ccbb4-3ad3-4ffa-b205-32968e961896] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:57.723438 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e54df979-69d8-4d54-a67e-30d768028296 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:57.724039 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e54df979-69d8-4d54-a67e-30d768028296 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:57.726315 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e54df979-69d8-4d54-a67e-30d768028296 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:57.726796 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e54df979-69d8-4d54-a67e-30d768028296 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:58.078405 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-e54df979-69d8-4d54-a67e-30d768028296 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:58.087185 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-e54df979-69d8-4d54-a67e-30d768028296 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/1a6ccbb4-3ad3-4ffa-b205-32968e961896" status: 200 len: 1317 microversion: 2.1 time: 0.379063 Apr 30 13:19:58.087760 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 282/490] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:57 2021] GET /compute/v2.1/servers/1a6ccbb4-3ad3-4ffa-b205-32968e961896 => generated 1317 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:58.158641 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-3556d114-e4c6-4f18-9924-840b06f53d57 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:58.160156 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-3556d114-e4c6-4f18-9924-840b06f53d57 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:58.169935 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3556d114-e4c6-4f18-9924-840b06f53d57 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:58.170645 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3556d114-e4c6-4f18-9924-840b06f53d57 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:58.171514 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3556d114-e4c6-4f18-9924-840b06f53d57 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:58.172155 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3556d114-e4c6-4f18-9924-840b06f53d57 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:58.331206 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-6ad1f2e1-ae08-4e43-afc0-c12edea851b6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:58.331887 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-6ad1f2e1-ae08-4e43-afc0-c12edea851b6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:58.339381 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6ad1f2e1-ae08-4e43-afc0-c12edea851b6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:58.339937 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6ad1f2e1-ae08-4e43-afc0-c12edea851b6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:58.340814 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6ad1f2e1-ae08-4e43-afc0-c12edea851b6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:58.341827 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6ad1f2e1-ae08-4e43-afc0-c12edea851b6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:58.538890 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-3556d114-e4c6-4f18-9924-840b06f53d57 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:58.563847 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-6ad1f2e1-ae08-4e43-afc0-c12edea851b6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:58.571638 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-3556d114-e4c6-4f18-9924-840b06f53d57 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1566 microversion: 2.1 time: 0.411901 Apr 30 13:19:58.571638 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 209/491] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:58 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1566 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:58.583289 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-6ad1f2e1-ae08-4e43-afc0-c12edea851b6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:58.584765 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-6ad1f2e1-ae08-4e43-afc0-c12edea851b6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:58.585950 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-6ad1f2e1-ae08-4e43-afc0-c12edea851b6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1750 microversion: 2.20 time: 0.258943 Apr 30 13:19:58.586553 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 283/492] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:19:58 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1750 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:19:59.105802 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-209b56ce-d3f2-4633-a3ff-7c6af26b2b79 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:59.107152 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-209b56ce-d3f2-4633-a3ff-7c6af26b2b79 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 1a6ccbb4-3ad3-4ffa-b205-32968e961896] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:59.118126 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-209b56ce-d3f2-4633-a3ff-7c6af26b2b79 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:59.118908 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-209b56ce-d3f2-4633-a3ff-7c6af26b2b79 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:59.120006 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-209b56ce-d3f2-4633-a3ff-7c6af26b2b79 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:59.120766 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-209b56ce-d3f2-4633-a3ff-7c6af26b2b79 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:59.517097 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-209b56ce-d3f2-4633-a3ff-7c6af26b2b79 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:59.527375 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-209b56ce-d3f2-4633-a3ff-7c6af26b2b79 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/1a6ccbb4-3ad3-4ffa-b205-32968e961896" status: 200 len: 1317 microversion: 2.1 time: 0.426213 Apr 30 13:19:59.528296 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 210/493] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:59 2021] GET /compute/v2.1/servers/1a6ccbb4-3ad3-4ffa-b205-32968e961896 => generated 1317 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:19:59.588006 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-42863533-2fd1-4703-98cf-e934aef1d733 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:59.590074 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-42863533-2fd1-4703-98cf-e934aef1d733 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:59.598707 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-42863533-2fd1-4703-98cf-e934aef1d733 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:59.599519 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-42863533-2fd1-4703-98cf-e934aef1d733 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:59.600476 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-42863533-2fd1-4703-98cf-e934aef1d733 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:59.601471 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-42863533-2fd1-4703-98cf-e934aef1d733 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:59.607284 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-2239f4e8-da7c-4244-998b-44501c47dd4f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:19:59.608327 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-2239f4e8-da7c-4244-998b-44501c47dd4f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:19:59.619508 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2239f4e8-da7c-4244-998b-44501c47dd4f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:59.620129 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2239f4e8-da7c-4244-998b-44501c47dd4f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:59.621265 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2239f4e8-da7c-4244-998b-44501c47dd4f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:19:59.621788 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2239f4e8-da7c-4244-998b-44501c47dd4f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:19:59.880957 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-42863533-2fd1-4703-98cf-e934aef1d733 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:19:59.892124 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-42863533-2fd1-4703-98cf-e934aef1d733 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1566 microversion: 2.1 time: 0.308804 Apr 30 13:19:59.901851 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 284/494] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:19:59 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1566 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:00.267011 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-2239f4e8-da7c-4244-998b-44501c47dd4f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:00.287461 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-2239f4e8-da7c-4244-998b-44501c47dd4f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:00.290931 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-2239f4e8-da7c-4244-998b-44501c47dd4f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:00.294023 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-2239f4e8-da7c-4244-998b-44501c47dd4f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1750 microversion: 2.20 time: 0.691459 Apr 30 13:20:00.295131 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 211/495] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:19:59 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1750 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:20:00.546976 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-c460333d-23c9-40d1-a16a-43ce0007e96b tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:00.547598 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-c460333d-23c9-40d1-a16a-43ce0007e96b tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 1a6ccbb4-3ad3-4ffa-b205-32968e961896] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:00.555713 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c460333d-23c9-40d1-a16a-43ce0007e96b tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:00.556194 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c460333d-23c9-40d1-a16a-43ce0007e96b tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:00.557073 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c460333d-23c9-40d1-a16a-43ce0007e96b tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:00.557523 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c460333d-23c9-40d1-a16a-43ce0007e96b tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:00.860717 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-c460333d-23c9-40d1-a16a-43ce0007e96b tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:00.869915 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-c460333d-23c9-40d1-a16a-43ce0007e96b tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/1a6ccbb4-3ad3-4ffa-b205-32968e961896" status: 200 len: 1317 microversion: 2.1 time: 0.327081 Apr 30 13:20:00.871064 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 285/496] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:00 2021] GET /compute/v2.1/servers/1a6ccbb4-3ad3-4ffa-b205-32968e961896 => generated 1317 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:00.916642 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-790b5f83-2f2f-4648-8cd6-ad58840db594 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:00.918655 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-790b5f83-2f2f-4648-8cd6-ad58840db594 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:00.928251 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-790b5f83-2f2f-4648-8cd6-ad58840db594 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:00.928966 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-790b5f83-2f2f-4648-8cd6-ad58840db594 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:00.929940 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-790b5f83-2f2f-4648-8cd6-ad58840db594 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:00.930424 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-790b5f83-2f2f-4648-8cd6-ad58840db594 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:01.312689 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-97ffe27f-aded-4c1d-aea6-f551ae60ffb1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:01.313221 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-97ffe27f-aded-4c1d-aea6-f551ae60ffb1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:01.321613 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-97ffe27f-aded-4c1d-aea6-f551ae60ffb1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:01.322328 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-97ffe27f-aded-4c1d-aea6-f551ae60ffb1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:01.323292 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-97ffe27f-aded-4c1d-aea6-f551ae60ffb1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:01.323898 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-97ffe27f-aded-4c1d-aea6-f551ae60ffb1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:01.459692 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-790b5f83-2f2f-4648-8cd6-ad58840db594 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:01.481265 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-790b5f83-2f2f-4648-8cd6-ad58840db594 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1546 microversion: 2.1 time: 0.565365 Apr 30 13:20:01.484091 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 212/497] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:00 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1546 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:20:01.502088 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-98c885e5-6c6e-4929-be79-4d5364443e31 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:01.502737 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-98c885e5-6c6e-4929-be79-4d5364443e31 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:01.518195 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-98c885e5-6c6e-4929-be79-4d5364443e31 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:01.518656 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-98c885e5-6c6e-4929-be79-4d5364443e31 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:01.523465 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-98c885e5-6c6e-4929-be79-4d5364443e31 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:01.524160 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-98c885e5-6c6e-4929-be79-4d5364443e31 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:01.726438 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-97ffe27f-aded-4c1d-aea6-f551ae60ffb1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:01.744232 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-97ffe27f-aded-4c1d-aea6-f551ae60ffb1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:01.747392 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-97ffe27f-aded-4c1d-aea6-f551ae60ffb1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:01.749133 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-97ffe27f-aded-4c1d-aea6-f551ae60ffb1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1806 microversion: 2.20 time: 0.440358 Apr 30 13:20:01.750542 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 286/498] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:20:01 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1806 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:20:01.888090 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-d2217cca-95b7-4c37-ae82-e0cf7725ab76 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:01.889624 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-d2217cca-95b7-4c37-ae82-e0cf7725ab76 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 1a6ccbb4-3ad3-4ffa-b205-32968e961896] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:01.907230 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d2217cca-95b7-4c37-ae82-e0cf7725ab76 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:01.908468 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d2217cca-95b7-4c37-ae82-e0cf7725ab76 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:01.910924 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d2217cca-95b7-4c37-ae82-e0cf7725ab76 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:01.912944 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d2217cca-95b7-4c37-ae82-e0cf7725ab76 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:01.932396 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.wsgi [None req-98c885e5-6c6e-4929-be79-4d5364443e31 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] HTTP exception thrown: Cannot 'detach_volume' instance aa7277ee-287a-481c-a0e8-ae4dc4053a0e while it is in vm_state rescued Apr 30 13:20:01.935220 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-98c885e5-6c6e-4929-be79-4d5364443e31 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Returning 409 to user: Cannot 'detach_volume' instance aa7277ee-287a-481c-a0e8-ae4dc4053a0e while it is in vm_state rescued {{(pid=87932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:20:01.939907 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-98c885e5-6c6e-4929-be79-4d5364443e31 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "DELETE /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e/os-volume_attachments/a7e6e7b0-0c46-4275-9fbb-194d67197568" status: 409 len: 152 microversion: 2.1 time: 0.439333 Apr 30 13:20:01.942330 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 213/499] 10.222.0.79 () {58 vars in 1416 bytes} [Fri Apr 30 13:20:01 2021] DELETE /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e/os-volume_attachments/a7e6e7b0-0c46-4275-9fbb-194d67197568 => generated 152 bytes in 446 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Apr 30 13:20:01.955557 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-46682d73-ef8c-4df0-b863-1d8aeb4927ac tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:20:01.957149 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-46682d73-ef8c-4df0-b863-1d8aeb4927ac tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:01.986408 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-46682d73-ef8c-4df0-b863-1d8aeb4927ac tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:01.990717 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-46682d73-ef8c-4df0-b863-1d8aeb4927ac tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:01.994526 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-46682d73-ef8c-4df0-b863-1d8aeb4927ac tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:01.995306 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-46682d73-ef8c-4df0-b863-1d8aeb4927ac tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:02.373961 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-d2217cca-95b7-4c37-ae82-e0cf7725ab76 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:02.383645 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-d2217cca-95b7-4c37-ae82-e0cf7725ab76 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/1a6ccbb4-3ad3-4ffa-b205-32968e961896" status: 200 len: 1317 microversion: 2.1 time: 0.499818 Apr 30 13:20:02.384240 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 287/500] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:01 2021] GET /compute/v2.1/servers/1a6ccbb4-3ad3-4ffa-b205-32968e961896 => generated 1317 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:20:02.400549 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-46682d73-ef8c-4df0-b863-1d8aeb4927ac tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "POST /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e/action" status: 202 len: 0 microversion: 2.1 time: 0.450466 Apr 30 13:20:02.401793 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 214/501] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:20:01 2021] POST /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e/action => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 13:20:02.414806 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-ce2d3b69-6eb3-4ea4-b5c3-38baa3e09e44 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:02.415980 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-ce2d3b69-6eb3-4ea4-b5c3-38baa3e09e44 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:02.424495 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ce2d3b69-6eb3-4ea4-b5c3-38baa3e09e44 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:02.425309 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ce2d3b69-6eb3-4ea4-b5c3-38baa3e09e44 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:02.426619 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ce2d3b69-6eb3-4ea4-b5c3-38baa3e09e44 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:02.427235 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ce2d3b69-6eb3-4ea4-b5c3-38baa3e09e44 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:02.770566 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-3be2ea27-43be-461d-911d-d1c09fbd04ac tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:02.775339 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-3be2ea27-43be-461d-911d-d1c09fbd04ac tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:02.815402 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3be2ea27-43be-461d-911d-d1c09fbd04ac tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:02.815402 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3be2ea27-43be-461d-911d-d1c09fbd04ac tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:02.816524 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3be2ea27-43be-461d-911d-d1c09fbd04ac tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:02.829227 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3be2ea27-43be-461d-911d-d1c09fbd04ac tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:03.056797 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-ce2d3b69-6eb3-4ea4-b5c3-38baa3e09e44 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:03.077341 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-ce2d3b69-6eb3-4ea4-b5c3-38baa3e09e44 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1554 microversion: 2.1 time: 0.669198 Apr 30 13:20:03.078220 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 288/502] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:02 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1554 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:03.400570 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-3a755c2e-402b-4944-b412-bc3ef1640f36 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:03.401108 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-3a755c2e-402b-4944-b412-bc3ef1640f36 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 1a6ccbb4-3ad3-4ffa-b205-32968e961896] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:03.414184 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3a755c2e-402b-4944-b412-bc3ef1640f36 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:03.414819 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3a755c2e-402b-4944-b412-bc3ef1640f36 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:03.415904 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3a755c2e-402b-4944-b412-bc3ef1640f36 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:03.416517 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3a755c2e-402b-4944-b412-bc3ef1640f36 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:03.668540 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-3be2ea27-43be-461d-911d-d1c09fbd04ac tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:03.680436 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-3be2ea27-43be-461d-911d-d1c09fbd04ac tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:03.683004 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-3be2ea27-43be-461d-911d-d1c09fbd04ac tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:03.684629 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-3be2ea27-43be-461d-911d-d1c09fbd04ac tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1806 microversion: 2.20 time: 0.920267 Apr 30 13:20:03.697994 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 215/503] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:20:02 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1806 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:20:03.883298 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-3a755c2e-402b-4944-b412-bc3ef1640f36 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:03.898563 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-3a755c2e-402b-4944-b412-bc3ef1640f36 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/1a6ccbb4-3ad3-4ffa-b205-32968e961896" status: 200 len: 1507 microversion: 2.1 time: 0.498703 Apr 30 13:20:03.899545 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 289/504] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:03 2021] GET /compute/v2.1/servers/1a6ccbb4-3ad3-4ffa-b205-32968e961896 => generated 1507 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:04.100022 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-4362e5c8-7919-416b-bc9e-a80720e9f108 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:04.101031 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-4362e5c8-7919-416b-bc9e-a80720e9f108 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:04.120195 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4362e5c8-7919-416b-bc9e-a80720e9f108 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:04.122668 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4362e5c8-7919-416b-bc9e-a80720e9f108 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:04.126264 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4362e5c8-7919-416b-bc9e-a80720e9f108 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:04.127164 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4362e5c8-7919-416b-bc9e-a80720e9f108 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:04.704498 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-7bd16c5e-5b44-4c55-ad6b-8bb477c001ad tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:04.705751 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-7bd16c5e-5b44-4c55-ad6b-8bb477c001ad tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:04.726531 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7bd16c5e-5b44-4c55-ad6b-8bb477c001ad tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:04.727360 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7bd16c5e-5b44-4c55-ad6b-8bb477c001ad tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:04.728572 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7bd16c5e-5b44-4c55-ad6b-8bb477c001ad tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:04.729196 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7bd16c5e-5b44-4c55-ad6b-8bb477c001ad tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:04.939971 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-4362e5c8-7919-416b-bc9e-a80720e9f108 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:04.951050 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-4362e5c8-7919-416b-bc9e-a80720e9f108 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1554 microversion: 2.1 time: 0.855762 Apr 30 13:20:04.962326 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 216/505] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:04 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1554 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:20:05.082399 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-7bd16c5e-5b44-4c55-ad6b-8bb477c001ad tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:05.092908 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-7bd16c5e-5b44-4c55-ad6b-8bb477c001ad tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:05.094630 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-7bd16c5e-5b44-4c55-ad6b-8bb477c001ad tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:05.095879 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-7bd16c5e-5b44-4c55-ad6b-8bb477c001ad tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1806 microversion: 2.20 time: 0.395178 Apr 30 13:20:05.096755 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 290/506] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:20:04 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1806 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:20:05.973242 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-992d4c9d-a89e-4a3e-9bcb-a576b1c80b6e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:05.974368 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-992d4c9d-a89e-4a3e-9bcb-a576b1c80b6e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:06.010535 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-992d4c9d-a89e-4a3e-9bcb-a576b1c80b6e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:06.011274 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-992d4c9d-a89e-4a3e-9bcb-a576b1c80b6e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:06.012630 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-992d4c9d-a89e-4a3e-9bcb-a576b1c80b6e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:06.017056 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-992d4c9d-a89e-4a3e-9bcb-a576b1c80b6e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:06.262907 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-a9a7f6ae-afe8-42ce-ba95-712453eb1d1f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:06.263746 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-a9a7f6ae-afe8-42ce-ba95-712453eb1d1f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:06.272935 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a9a7f6ae-afe8-42ce-ba95-712453eb1d1f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:06.273612 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a9a7f6ae-afe8-42ce-ba95-712453eb1d1f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:06.274649 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a9a7f6ae-afe8-42ce-ba95-712453eb1d1f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:06.277679 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a9a7f6ae-afe8-42ce-ba95-712453eb1d1f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:07.049197 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-a9a7f6ae-afe8-42ce-ba95-712453eb1d1f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:07.079585 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-a9a7f6ae-afe8-42ce-ba95-712453eb1d1f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:07.087812 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-a9a7f6ae-afe8-42ce-ba95-712453eb1d1f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:07.089562 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-a9a7f6ae-afe8-42ce-ba95-712453eb1d1f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1806 microversion: 2.20 time: 0.974622 Apr 30 13:20:07.107788 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 291/507] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:20:06 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1806 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:20:07.283730 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-28e67b56-d45e-4027-bae6-e99d5c259e04 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "87c3583e-a92c-4819-abcd-f5e8d01e6b11"}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:20:07.286513 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-28e67b56-d45e-4027-bae6-e99d5c259e04 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 1a6ccbb4-3ad3-4ffa-b205-32968e961896] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:07.296193 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-28e67b56-d45e-4027-bae6-e99d5c259e04 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:07.297036 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-28e67b56-d45e-4027-bae6-e99d5c259e04 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:07.298109 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-28e67b56-d45e-4027-bae6-e99d5c259e04 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:07.299221 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-28e67b56-d45e-4027-bae6-e99d5c259e04 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:07.692580 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-992d4c9d-a89e-4a3e-9bcb-a576b1c80b6e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:07.712021 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-992d4c9d-a89e-4a3e-9bcb-a576b1c80b6e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1554 microversion: 2.1 time: 1.745770 Apr 30 13:20:07.718372 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 217/508] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:05 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1554 bytes in 1753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:08.122760 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-d15f349f-f245-44e6-9bab-824cd277e9f3 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:08.123738 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-d15f349f-f245-44e6-9bab-824cd277e9f3 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:08.148021 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d15f349f-f245-44e6-9bab-824cd277e9f3 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:08.150312 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d15f349f-f245-44e6-9bab-824cd277e9f3 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:08.153609 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d15f349f-f245-44e6-9bab-824cd277e9f3 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:08.154906 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d15f349f-f245-44e6-9bab-824cd277e9f3 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:08.716563 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-28e67b56-d45e-4027-bae6-e99d5c259e04 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "POST /compute/v2.1/servers/1a6ccbb4-3ad3-4ffa-b205-32968e961896/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.441080 Apr 30 13:20:08.741144 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 292/509] 10.222.0.79 () {60 vars in 1323 bytes} [Fri Apr 30 13:20:07 2021] POST /compute/v2.1/servers/1a6ccbb4-3ad3-4ffa-b205-32968e961896/os-volume_attachments => generated 194 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:20:08.787990 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-1495d00f-7f01-4ce0-899f-72d731ecdafe tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:08.807665 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-1495d00f-7f01-4ce0-899f-72d731ecdafe tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:08.847703 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1495d00f-7f01-4ce0-899f-72d731ecdafe tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:08.851155 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1495d00f-7f01-4ce0-899f-72d731ecdafe tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:08.855838 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1495d00f-7f01-4ce0-899f-72d731ecdafe tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:08.858226 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1495d00f-7f01-4ce0-899f-72d731ecdafe tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:09.408258 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-1495d00f-7f01-4ce0-899f-72d731ecdafe tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:09.421948 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-1495d00f-7f01-4ce0-899f-72d731ecdafe tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1554 microversion: 2.1 time: 0.653274 Apr 30 13:20:09.423192 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 293/510] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:08 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1554 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:10.449285 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b2649f7d-b683-48fe-841b-fbf597bed3b5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:10.450153 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-b2649f7d-b683-48fe-841b-fbf597bed3b5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:10.482955 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b2649f7d-b683-48fe-841b-fbf597bed3b5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:10.484594 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b2649f7d-b683-48fe-841b-fbf597bed3b5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:10.485052 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-d15f349f-f245-44e6-9bab-824cd277e9f3 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:10.487079 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b2649f7d-b683-48fe-841b-fbf597bed3b5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:10.490142 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b2649f7d-b683-48fe-841b-fbf597bed3b5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:10.508024 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-d15f349f-f245-44e6-9bab-824cd277e9f3 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:10.512860 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-d15f349f-f245-44e6-9bab-824cd277e9f3 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:10.518572 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-d15f349f-f245-44e6-9bab-824cd277e9f3 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1806 microversion: 2.20 time: 2.408822 Apr 30 13:20:10.536570 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 218/511] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:20:08 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1806 bytes in 2427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:20:11.412548 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-b2649f7d-b683-48fe-841b-fbf597bed3b5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:11.423539 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b2649f7d-b683-48fe-841b-fbf597bed3b5 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1554 microversion: 2.1 time: 0.978086 Apr 30 13:20:11.426527 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 294/512] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:10 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1554 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:20:11.542241 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-39ce550d-af2c-421d-999e-06f045ec9f46 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:11.542895 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-39ce550d-af2c-421d-999e-06f045ec9f46 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:11.558426 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-39ce550d-af2c-421d-999e-06f045ec9f46 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:11.559809 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-39ce550d-af2c-421d-999e-06f045ec9f46 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:11.562362 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-39ce550d-af2c-421d-999e-06f045ec9f46 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:11.565300 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-39ce550d-af2c-421d-999e-06f045ec9f46 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:12.073823 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-39ce550d-af2c-421d-999e-06f045ec9f46 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:12.085464 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-39ce550d-af2c-421d-999e-06f045ec9f46 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:12.094937 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-39ce550d-af2c-421d-999e-06f045ec9f46 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:12.103915 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-39ce550d-af2c-421d-999e-06f045ec9f46 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1806 microversion: 2.20 time: 0.563388 Apr 30 13:20:12.107159 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 219/513] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:20:11 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1806 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:20:12.452361 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-af99e491-4382-42a2-90eb-a6061bbee083 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:12.453198 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-af99e491-4382-42a2-90eb-a6061bbee083 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:12.470561 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-af99e491-4382-42a2-90eb-a6061bbee083 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:12.471025 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-af99e491-4382-42a2-90eb-a6061bbee083 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:12.471891 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-af99e491-4382-42a2-90eb-a6061bbee083 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:12.479769 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-af99e491-4382-42a2-90eb-a6061bbee083 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:13.129130 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-f72e5a16-ed19-422c-a38b-d78632e10a70 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:13.129980 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-f72e5a16-ed19-422c-a38b-d78632e10a70 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:13.154854 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f72e5a16-ed19-422c-a38b-d78632e10a70 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:13.157091 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f72e5a16-ed19-422c-a38b-d78632e10a70 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:13.159114 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f72e5a16-ed19-422c-a38b-d78632e10a70 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:13.163585 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-af99e491-4382-42a2-90eb-a6061bbee083 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:13.172401 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f72e5a16-ed19-422c-a38b-d78632e10a70 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:13.183546 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-af99e491-4382-42a2-90eb-a6061bbee083 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1554 microversion: 2.1 time: 0.735034 Apr 30 13:20:13.186421 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 295/514] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:12 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1554 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:13.750877 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-f72e5a16-ed19-422c-a38b-d78632e10a70 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:13.768243 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-f72e5a16-ed19-422c-a38b-d78632e10a70 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:13.774993 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-f72e5a16-ed19-422c-a38b-d78632e10a70 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:13.776795 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-f72e5a16-ed19-422c-a38b-d78632e10a70 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1806 microversion: 2.20 time: 0.653511 Apr 30 13:20:13.785172 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 220/515] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:20:13 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1806 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:20:14.204567 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-020d6e7e-9dfc-451f-ae96-0f21e208b957 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:14.206589 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-020d6e7e-9dfc-451f-ae96-0f21e208b957 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:14.229281 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-020d6e7e-9dfc-451f-ae96-0f21e208b957 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:14.230189 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-020d6e7e-9dfc-451f-ae96-0f21e208b957 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:14.231321 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-020d6e7e-9dfc-451f-ae96-0f21e208b957 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:14.233542 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-020d6e7e-9dfc-451f-ae96-0f21e208b957 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:14.809074 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-fc062d3f-8c7a-4858-9135-2074c718ba2a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:14.809812 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-fc062d3f-8c7a-4858-9135-2074c718ba2a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:14.820915 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fc062d3f-8c7a-4858-9135-2074c718ba2a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:14.826001 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fc062d3f-8c7a-4858-9135-2074c718ba2a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:14.828851 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fc062d3f-8c7a-4858-9135-2074c718ba2a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:14.831824 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fc062d3f-8c7a-4858-9135-2074c718ba2a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:14.839927 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-020d6e7e-9dfc-451f-ae96-0f21e208b957 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:14.872815 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-020d6e7e-9dfc-451f-ae96-0f21e208b957 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1554 microversion: 2.1 time: 0.673484 Apr 30 13:20:14.885780 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 296/516] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:14 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1554 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:20:15.234947 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-fc062d3f-8c7a-4858-9135-2074c718ba2a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:15.249088 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-fc062d3f-8c7a-4858-9135-2074c718ba2a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:15.258809 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-fc062d3f-8c7a-4858-9135-2074c718ba2a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:15.261308 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-fc062d3f-8c7a-4858-9135-2074c718ba2a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1806 microversion: 2.20 time: 0.467474 Apr 30 13:20:15.272924 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 221/517] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:20:14 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1806 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:20:15.892897 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-1fcb0303-7dfe-41d7-be49-8cc806b05e38 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:15.895572 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-1fcb0303-7dfe-41d7-be49-8cc806b05e38 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:15.932778 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1fcb0303-7dfe-41d7-be49-8cc806b05e38 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:15.933753 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1fcb0303-7dfe-41d7-be49-8cc806b05e38 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:15.935013 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1fcb0303-7dfe-41d7-be49-8cc806b05e38 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:15.935779 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1fcb0303-7dfe-41d7-be49-8cc806b05e38 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:16.313893 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-7cc09cc2-972f-4077-acf0-9e141d53946e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:16.322401 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-7cc09cc2-972f-4077-acf0-9e141d53946e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:16.373562 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7cc09cc2-972f-4077-acf0-9e141d53946e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:16.374047 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7cc09cc2-972f-4077-acf0-9e141d53946e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:16.376475 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7cc09cc2-972f-4077-acf0-9e141d53946e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:16.377010 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7cc09cc2-972f-4077-acf0-9e141d53946e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:17.155220 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-7cc09cc2-972f-4077-acf0-9e141d53946e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:17.170871 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-7cc09cc2-972f-4077-acf0-9e141d53946e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:17.172857 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-7cc09cc2-972f-4077-acf0-9e141d53946e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:17.174136 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-7cc09cc2-972f-4077-acf0-9e141d53946e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1806 microversion: 2.20 time: 0.895296 Apr 30 13:20:17.176143 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 222/518] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:20:16 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1806 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:20:17.390593 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-1fcb0303-7dfe-41d7-be49-8cc806b05e38 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:17.404467 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-1fcb0303-7dfe-41d7-be49-8cc806b05e38 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1554 microversion: 2.1 time: 1.516673 Apr 30 13:20:17.405086 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 297/519] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:15 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1554 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:18.195768 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-fbb85e3e-639d-4959-b5e1-e37ec55fe035 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:18.197019 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-fbb85e3e-639d-4959-b5e1-e37ec55fe035 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:18.246263 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fbb85e3e-639d-4959-b5e1-e37ec55fe035 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:18.252679 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fbb85e3e-639d-4959-b5e1-e37ec55fe035 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:18.259868 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fbb85e3e-639d-4959-b5e1-e37ec55fe035 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:18.260585 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fbb85e3e-639d-4959-b5e1-e37ec55fe035 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:18.441629 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-e66cebf8-6535-4790-9a6c-f812d62613fe tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:18.443006 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-e66cebf8-6535-4790-9a6c-f812d62613fe tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:18.473786 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e66cebf8-6535-4790-9a6c-f812d62613fe tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:18.476183 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e66cebf8-6535-4790-9a6c-f812d62613fe tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:18.477497 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e66cebf8-6535-4790-9a6c-f812d62613fe tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:18.484549 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e66cebf8-6535-4790-9a6c-f812d62613fe tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:19.009740 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-fbb85e3e-639d-4959-b5e1-e37ec55fe035 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:19.030563 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-fbb85e3e-639d-4959-b5e1-e37ec55fe035 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:19.049459 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-fbb85e3e-639d-4959-b5e1-e37ec55fe035 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:19.053728 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-fbb85e3e-639d-4959-b5e1-e37ec55fe035 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1806 microversion: 2.20 time: 0.861700 Apr 30 13:20:19.066390 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 223/520] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:20:18 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1806 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:20:19.943176 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-e66cebf8-6535-4790-9a6c-f812d62613fe tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:20.010305 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-e66cebf8-6535-4790-9a6c-f812d62613fe tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1554 microversion: 2.1 time: 1.562985 Apr 30 13:20:20.025611 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 298/521] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:18 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1554 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:20.082188 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-7a3e16c3-d8a2-4a85-b03b-7d8a8bdd608e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:20.083045 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-7a3e16c3-d8a2-4a85-b03b-7d8a8bdd608e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:20.102310 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7a3e16c3-d8a2-4a85-b03b-7d8a8bdd608e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:20.118786 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7a3e16c3-d8a2-4a85-b03b-7d8a8bdd608e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:20.120059 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7a3e16c3-d8a2-4a85-b03b-7d8a8bdd608e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:20.120902 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7a3e16c3-d8a2-4a85-b03b-7d8a8bdd608e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:20.736238 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-7a3e16c3-d8a2-4a85-b03b-7d8a8bdd608e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:20.753667 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-7a3e16c3-d8a2-4a85-b03b-7d8a8bdd608e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:20.756128 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-7a3e16c3-d8a2-4a85-b03b-7d8a8bdd608e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:20.761994 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-7a3e16c3-d8a2-4a85-b03b-7d8a8bdd608e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1806 microversion: 2.20 time: 0.684530 Apr 30 13:20:20.762653 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 224/522] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:20:20 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1806 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:20:21.033179 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-9f181d91-0a7b-4cf7-a643-3dcf4bb92424 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:21.037074 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-9f181d91-0a7b-4cf7-a643-3dcf4bb92424 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:21.058837 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9f181d91-0a7b-4cf7-a643-3dcf4bb92424 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:21.059304 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9f181d91-0a7b-4cf7-a643-3dcf4bb92424 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:21.065200 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9f181d91-0a7b-4cf7-a643-3dcf4bb92424 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:21.069250 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9f181d91-0a7b-4cf7-a643-3dcf4bb92424 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:21.728461 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-9f181d91-0a7b-4cf7-a643-3dcf4bb92424 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:21.788548 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-fb89eafa-b165-437e-8f40-2408239d12fa tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:21.790454 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-9f181d91-0a7b-4cf7-a643-3dcf4bb92424 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1554 microversion: 2.1 time: 0.746396 Apr 30 13:20:21.794510 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-fb89eafa-b165-437e-8f40-2408239d12fa tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:21.819673 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 299/523] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:21 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1554 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:20:21.840168 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fb89eafa-b165-437e-8f40-2408239d12fa tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:21.841013 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fb89eafa-b165-437e-8f40-2408239d12fa tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:21.847414 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fb89eafa-b165-437e-8f40-2408239d12fa tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:21.851660 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fb89eafa-b165-437e-8f40-2408239d12fa tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:22.381913 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:20:22.382568 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: Fri Apr 30 13:20:22 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:20:22.828139 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-dc904ee3-bfe7-4145-926a-acab05dc359b tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:22.828823 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-dc904ee3-bfe7-4145-926a-acab05dc359b tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:22.840549 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-dc904ee3-bfe7-4145-926a-acab05dc359b tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:22.854206 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-dc904ee3-bfe7-4145-926a-acab05dc359b tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:22.855714 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-dc904ee3-bfe7-4145-926a-acab05dc359b tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:22.856328 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-dc904ee3-bfe7-4145-926a-acab05dc359b tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:23.428182 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-dc904ee3-bfe7-4145-926a-acab05dc359b tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:23.443870 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-dc904ee3-bfe7-4145-926a-acab05dc359b tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1554 microversion: 2.1 time: 0.620233 Apr 30 13:20:23.445113 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 300/524] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:22 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1554 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:23.648879 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-fb89eafa-b165-437e-8f40-2408239d12fa tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:23.682172 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-fb89eafa-b165-437e-8f40-2408239d12fa tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:23.692581 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-fb89eafa-b165-437e-8f40-2408239d12fa tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:23.698545 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-fb89eafa-b165-437e-8f40-2408239d12fa tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1806 microversion: 2.20 time: 1.919611 Apr 30 13:20:23.702413 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 225/525] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:20:21 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1806 bytes in 1927 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:20:24.463049 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b301cf81-e3ea-4db2-8914-97792d8639d9 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:24.463843 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-b301cf81-e3ea-4db2-8914-97792d8639d9 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:24.477349 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b301cf81-e3ea-4db2-8914-97792d8639d9 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:24.479119 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b301cf81-e3ea-4db2-8914-97792d8639d9 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:24.482822 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b301cf81-e3ea-4db2-8914-97792d8639d9 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:24.483473 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b301cf81-e3ea-4db2-8914-97792d8639d9 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:24.729701 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-1aa43209-81ed-463e-9190-b8f3bea9ded4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:24.731074 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-1aa43209-81ed-463e-9190-b8f3bea9ded4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:24.740739 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1aa43209-81ed-463e-9190-b8f3bea9ded4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:24.741613 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1aa43209-81ed-463e-9190-b8f3bea9ded4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:24.742694 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1aa43209-81ed-463e-9190-b8f3bea9ded4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:24.743400 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1aa43209-81ed-463e-9190-b8f3bea9ded4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:25.021720 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-b301cf81-e3ea-4db2-8914-97792d8639d9 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:25.035733 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b301cf81-e3ea-4db2-8914-97792d8639d9 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1554 microversion: 2.1 time: 0.576961 Apr 30 13:20:25.037049 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 301/526] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:24 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1554 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:25.929611 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-1aa43209-81ed-463e-9190-b8f3bea9ded4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:25.943667 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-1aa43209-81ed-463e-9190-b8f3bea9ded4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:25.949143 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-1aa43209-81ed-463e-9190-b8f3bea9ded4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:25.950751 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-1aa43209-81ed-463e-9190-b8f3bea9ded4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1806 microversion: 2.20 time: 1.225289 Apr 30 13:20:25.966290 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 226/527] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:20:24 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1806 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:20:26.069445 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-9cc65b43-359f-4b71-a885-863e179bae98 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:26.078967 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-9cc65b43-359f-4b71-a885-863e179bae98 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:26.101495 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9cc65b43-359f-4b71-a885-863e179bae98 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:26.102407 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9cc65b43-359f-4b71-a885-863e179bae98 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:26.103699 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9cc65b43-359f-4b71-a885-863e179bae98 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:26.104147 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9cc65b43-359f-4b71-a885-863e179bae98 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:26.557947 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-9cc65b43-359f-4b71-a885-863e179bae98 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:26.572110 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-9cc65b43-359f-4b71-a885-863e179bae98 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1554 microversion: 2.1 time: 0.506568 Apr 30 13:20:26.573088 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 302/528] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:26 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1554 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:26.973459 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-deef7e18-77b0-45a4-8633-29efc3a0b5c6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:26.974393 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-deef7e18-77b0-45a4-8633-29efc3a0b5c6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:26.994595 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-deef7e18-77b0-45a4-8633-29efc3a0b5c6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:26.996624 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-deef7e18-77b0-45a4-8633-29efc3a0b5c6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:27.003815 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-deef7e18-77b0-45a4-8633-29efc3a0b5c6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:27.005905 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-deef7e18-77b0-45a4-8633-29efc3a0b5c6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:27.234780 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-7307b62c-7ff0-435f-8fe3-59cead87eab9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Action: 'create', calling method: .version_select at 0x7f75001e53a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-2009375504"}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:20:27.285576 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.quota [None req-7307b62c-7ff0-435f-8fe3-59cead87eab9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Getting quotas for project 4d9dbe0005674e0899b90b9db4c9423e. Resources: {'key_pairs'} {{(pid=87932) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:20:27.304106 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.quota [None req-7307b62c-7ff0-435f-8fe3-59cead87eab9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Getting quotas for user a10ef3b5434242cc8c5b15a1bb36f735 and project 4d9dbe0005674e0899b90b9db4c9423e. Resources: {'key_pairs'} {{(pid=87932) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:20:27.494063 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-deef7e18-77b0-45a4-8633-29efc3a0b5c6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:27.510491 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-deef7e18-77b0-45a4-8633-29efc3a0b5c6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:27.513208 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-deef7e18-77b0-45a4-8633-29efc3a0b5c6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:27.524552 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-deef7e18-77b0-45a4-8633-29efc3a0b5c6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1806 microversion: 2.20 time: 0.555469 Apr 30 13:20:27.525614 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 303/529] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:20:26 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1806 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:20:27.597058 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-3c18a9aa-c8a6-436d-bc44-32a162442c3d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:27.603378 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-3c18a9aa-c8a6-436d-bc44-32a162442c3d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:27.616617 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.quota [None req-7307b62c-7ff0-435f-8fe3-59cead87eab9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Getting quotas for project 4d9dbe0005674e0899b90b9db4c9423e. Resources: {'key_pairs'} {{(pid=87932) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:20:27.617149 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3c18a9aa-c8a6-436d-bc44-32a162442c3d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:27.617808 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3c18a9aa-c8a6-436d-bc44-32a162442c3d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:27.619151 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3c18a9aa-c8a6-436d-bc44-32a162442c3d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:27.619700 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3c18a9aa-c8a6-436d-bc44-32a162442c3d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:27.623869 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.quota [None req-7307b62c-7ff0-435f-8fe3-59cead87eab9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Getting quotas for user a10ef3b5434242cc8c5b15a1bb36f735 and project 4d9dbe0005674e0899b90b9db4c9423e. Resources: {'key_pairs'} {{(pid=87932) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:20:27.653610 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-7307b62c-7ff0-435f-8fe3-59cead87eab9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 1.093211 Apr 30 13:20:27.662188 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 227/530] 10.222.0.79 () {60 vars in 1158 bytes} [Fri Apr 30 13:20:26 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:28.551047 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-b06b91c8-d581-4c01-bfdd-37ac8796eef0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:28.555491 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-b06b91c8-d581-4c01-bfdd-37ac8796eef0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:28.581635 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-3c18a9aa-c8a6-436d-bc44-32a162442c3d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:28.608513 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-3c18a9aa-c8a6-436d-bc44-32a162442c3d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1554 microversion: 2.1 time: 1.019648 Apr 30 13:20:28.611552 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 304/531] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:27 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1554 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:28.619432 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b06b91c8-d581-4c01-bfdd-37ac8796eef0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:28.620954 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b06b91c8-d581-4c01-bfdd-37ac8796eef0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:28.626665 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b06b91c8-d581-4c01-bfdd-37ac8796eef0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:28.627888 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b06b91c8-d581-4c01-bfdd-37ac8796eef0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:29.186401 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-b06b91c8-d581-4c01-bfdd-37ac8796eef0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:29.226898 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-b06b91c8-d581-4c01-bfdd-37ac8796eef0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:29.238445 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-b06b91c8-d581-4c01-bfdd-37ac8796eef0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:29.240860 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-b06b91c8-d581-4c01-bfdd-37ac8796eef0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1806 microversion: 2.20 time: 0.697164 Apr 30 13:20:29.243398 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 228/532] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:20:28 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1806 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:20:29.629651 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-2332e034-bbe5-4f75-9d4a-43de4c27416c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:29.630360 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-2332e034-bbe5-4f75-9d4a-43de4c27416c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:29.666581 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2332e034-bbe5-4f75-9d4a-43de4c27416c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:29.675828 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2332e034-bbe5-4f75-9d4a-43de4c27416c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:29.677103 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2332e034-bbe5-4f75-9d4a-43de4c27416c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:29.681060 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2332e034-bbe5-4f75-9d4a-43de4c27416c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:30.268369 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-eb2bb0e4-6cf3-4e07-bf01-ba3c853a2e99 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:30.274737 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-eb2bb0e4-6cf3-4e07-bf01-ba3c853a2e99 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:30.305048 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-2332e034-bbe5-4f75-9d4a-43de4c27416c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:30.318949 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-eb2bb0e4-6cf3-4e07-bf01-ba3c853a2e99 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:30.319786 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-eb2bb0e4-6cf3-4e07-bf01-ba3c853a2e99 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:30.321591 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-2332e034-bbe5-4f75-9d4a-43de4c27416c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1554 microversion: 2.1 time: 0.697036 Apr 30 13:20:30.331998 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 305/533] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:29 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1554 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:30.333557 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-eb2bb0e4-6cf3-4e07-bf01-ba3c853a2e99 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:30.333984 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-eb2bb0e4-6cf3-4e07-bf01-ba3c853a2e99 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:31.156794 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-d7aee8ca-ac08-477e-acea-8e4b21974f1a tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:31.157399 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-d7aee8ca-ac08-477e-acea-8e4b21974f1a tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: 8ae91590-af1f-473b-9391-f77fe37593f2] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:31.177617 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d7aee8ca-ac08-477e-acea-8e4b21974f1a tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:31.178110 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d7aee8ca-ac08-477e-acea-8e4b21974f1a tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:31.178937 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d7aee8ca-ac08-477e-acea-8e4b21974f1a tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:31.179377 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d7aee8ca-ac08-477e-acea-8e4b21974f1a tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:31.193558 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-eb2bb0e4-6cf3-4e07-bf01-ba3c853a2e99 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:31.206655 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-eb2bb0e4-6cf3-4e07-bf01-ba3c853a2e99 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:31.208193 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-eb2bb0e4-6cf3-4e07-bf01-ba3c853a2e99 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:31.224074 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-eb2bb0e4-6cf3-4e07-bf01-ba3c853a2e99 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1806 microversion: 2.20 time: 0.964560 Apr 30 13:20:31.232026 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 229/534] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:20:30 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1806 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:20:31.338927 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-c5337251-e6a2-4426-8034-7a92807c4833 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:31.339624 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-c5337251-e6a2-4426-8034-7a92807c4833 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:31.364659 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c5337251-e6a2-4426-8034-7a92807c4833 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:31.365089 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c5337251-e6a2-4426-8034-7a92807c4833 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:31.367825 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c5337251-e6a2-4426-8034-7a92807c4833 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:31.368199 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c5337251-e6a2-4426-8034-7a92807c4833 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:31.802695 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.objects.instance [None req-d7aee8ca-ac08-477e-acea-8e4b21974f1a tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lazy-loading 'services' on Instance uuid 8ae91590-af1f-473b-9391-f77fe37593f2 {{(pid=87933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:20:31.921943 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-c5337251-e6a2-4426-8034-7a92807c4833 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:31.942171 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-c5337251-e6a2-4426-8034-7a92807c4833 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1554 microversion: 2.1 time: 0.606823 Apr 30 13:20:31.952209 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 230/535] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:31 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1554 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:20:31.958260 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-9a342521-d35f-44a2-8c28-4078f3afe5ab tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:31.971163 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-9a342521-d35f-44a2-8c28-4078f3afe5ab tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 1a6ccbb4-3ad3-4ffa-b205-32968e961896] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:31.979229 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9a342521-d35f-44a2-8c28-4078f3afe5ab tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:31.980030 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9a342521-d35f-44a2-8c28-4078f3afe5ab tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:31.981056 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9a342521-d35f-44a2-8c28-4078f3afe5ab tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:31.985696 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9a342521-d35f-44a2-8c28-4078f3afe5ab tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:32.184410 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-d7aee8ca-ac08-477e-acea-8e4b21974f1a tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "DELETE /compute/v2.1/servers/8ae91590-af1f-473b-9391-f77fe37593f2/os-volume_attachments/6e375744-fffe-4616-ac31-900890d2691f" status: 202 len: 0 microversion: 2.1 time: 1.026325 Apr 30 13:20:32.196065 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 306/536] 10.222.0.79 () {58 vars in 1416 bytes} [Fri Apr 30 13:20:31 2021] DELETE /compute/v2.1/servers/8ae91590-af1f-473b-9391-f77fe37593f2/os-volume_attachments/6e375744-fffe-4616-ac31-900890d2691f => generated 0 bytes in 1044 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 13:20:32.250436 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-8b90fede-5210-498d-a4c6-0225df7765c5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:32.251527 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-8b90fede-5210-498d-a4c6-0225df7765c5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:32.275278 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8b90fede-5210-498d-a4c6-0225df7765c5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:32.276665 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8b90fede-5210-498d-a4c6-0225df7765c5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:32.277733 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8b90fede-5210-498d-a4c6-0225df7765c5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:32.278708 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8b90fede-5210-498d-a4c6-0225df7765c5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:32.337247 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.objects.instance [None req-9a342521-d35f-44a2-8c28-4078f3afe5ab tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lazy-loading 'services' on Instance uuid 1a6ccbb4-3ad3-4ffa-b205-32968e961896 {{(pid=87932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:20:32.799959 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-9a342521-d35f-44a2-8c28-4078f3afe5ab tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "DELETE /compute/v2.1/servers/1a6ccbb4-3ad3-4ffa-b205-32968e961896/os-volume_attachments/87c3583e-a92c-4819-abcd-f5e8d01e6b11" status: 202 len: 0 microversion: 2.1 time: 0.844210 Apr 30 13:20:32.804128 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 231/537] 10.222.0.79 () {58 vars in 1416 bytes} [Fri Apr 30 13:20:31 2021] DELETE /compute/v2.1/servers/1a6ccbb4-3ad3-4ffa-b205-32968e961896/os-volume_attachments/87c3583e-a92c-4819-abcd-f5e8d01e6b11 => generated 0 bytes in 851 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:20:32.962398 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-f30e2e29-166d-4c62-8557-92dabf43e147 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:32.963496 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-f30e2e29-166d-4c62-8557-92dabf43e147 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:32.994186 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-8b90fede-5210-498d-a4c6-0225df7765c5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:33.003161 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f30e2e29-166d-4c62-8557-92dabf43e147 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:33.011705 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f30e2e29-166d-4c62-8557-92dabf43e147 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:33.013392 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f30e2e29-166d-4c62-8557-92dabf43e147 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:33.019601 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-8b90fede-5210-498d-a4c6-0225df7765c5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:33.021235 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f30e2e29-166d-4c62-8557-92dabf43e147 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:33.022048 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-8b90fede-5210-498d-a4c6-0225df7765c5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:33.023714 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-8b90fede-5210-498d-a4c6-0225df7765c5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1806 microversion: 2.20 time: 0.781292 Apr 30 13:20:33.025224 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 307/538] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:20:32 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1806 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:20:33.522947 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-f30e2e29-166d-4c62-8557-92dabf43e147 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:33.556748 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-f30e2e29-166d-4c62-8557-92dabf43e147 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1560 microversion: 2.1 time: 0.600584 Apr 30 13:20:33.557767 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 232/539] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:32 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1560 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:33.761776 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-fa76759d-a2c9-4f30-8a76-391cb6afd2a6 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:33.768129 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-fa76759d-a2c9-4f30-8a76-391cb6afd2a6 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:33.786119 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-fa76759d-a2c9-4f30-8a76-391cb6afd2a6 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:33.787375 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-fa76759d-a2c9-4f30-8a76-391cb6afd2a6 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:33.789722 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-fa76759d-a2c9-4f30-8a76-391cb6afd2a6 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:33.790869 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-fa76759d-a2c9-4f30-8a76-391cb6afd2a6 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:34.045029 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-4fcd2595-3358-4617-9930-149336d81410 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:34.045722 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-4fcd2595-3358-4617-9930-149336d81410 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:34.057254 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4fcd2595-3358-4617-9930-149336d81410 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:34.060026 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4fcd2595-3358-4617-9930-149336d81410 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:34.061731 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4fcd2595-3358-4617-9930-149336d81410 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:34.062390 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4fcd2595-3358-4617-9930-149336d81410 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:34.110758 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.objects.instance [None req-fa76759d-a2c9-4f30-8a76-391cb6afd2a6 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lazy-loading 'services' on Instance uuid aa7277ee-287a-481c-a0e8-ae4dc4053a0e {{(pid=87933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:20:34.414213 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-fa76759d-a2c9-4f30-8a76-391cb6afd2a6 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "DELETE /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e/os-volume_attachments/a7e6e7b0-0c46-4275-9fbb-194d67197568" status: 202 len: 0 microversion: 2.1 time: 0.664269 Apr 30 13:20:34.424850 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 308/540] 10.222.0.79 () {58 vars in 1416 bytes} [Fri Apr 30 13:20:33 2021] DELETE /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e/os-volume_attachments/a7e6e7b0-0c46-4275-9fbb-194d67197568 => generated 0 bytes in 676 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:20:34.529898 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-4fcd2595-3358-4617-9930-149336d81410 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:34.544075 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-4fcd2595-3358-4617-9930-149336d81410 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:34.546180 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-4fcd2595-3358-4617-9930-149336d81410 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:34.547732 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-4fcd2595-3358-4617-9930-149336d81410 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1806 microversion: 2.20 time: 0.506864 Apr 30 13:20:34.548876 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 233/541] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:20:34 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1806 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:20:35.114772 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-ea87b4e4-944b-4213-b424-96a5c8a0d96e tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:35.115549 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-ea87b4e4-944b-4213-b424-96a5c8a0d96e tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: 8ae91590-af1f-473b-9391-f77fe37593f2] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:35.131162 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ea87b4e4-944b-4213-b424-96a5c8a0d96e tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:35.134088 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ea87b4e4-944b-4213-b424-96a5c8a0d96e tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:35.134088 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ea87b4e4-944b-4213-b424-96a5c8a0d96e tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:35.134088 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ea87b4e4-944b-4213-b424-96a5c8a0d96e tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:35.206223 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-ea87b4e4-944b-4213-b424-96a5c8a0d96e tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: 8ae91590-af1f-473b-9391-f77fe37593f2] Going to try to terminate instance {{(pid=87933) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 13:20:35.338931 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-ea87b4e4-944b-4213-b424-96a5c8a0d96e tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "DELETE /compute/v2.1/servers/8ae91590-af1f-473b-9391-f77fe37593f2" status: 204 len: 0 microversion: 2.1 time: 0.228902 Apr 30 13:20:35.339556 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 309/542] 10.222.0.79 () {58 vars in 1239 bytes} [Fri Apr 30 13:20:35 2021] DELETE /compute/v2.1/servers/8ae91590-af1f-473b-9391-f77fe37593f2 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 13:20:35.353203 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-a7770c15-f04b-472b-92c6-5af2405f8cb3 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:35.358841 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-a7770c15-f04b-472b-92c6-5af2405f8cb3 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: 8ae91590-af1f-473b-9391-f77fe37593f2] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:35.367574 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a7770c15-f04b-472b-92c6-5af2405f8cb3 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:35.368040 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a7770c15-f04b-472b-92c6-5af2405f8cb3 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:35.368841 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a7770c15-f04b-472b-92c6-5af2405f8cb3 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:35.369284 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a7770c15-f04b-472b-92c6-5af2405f8cb3 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:35.576181 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-46046e4b-39d1-4367-bfed-c4d8636b7d0e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:35.576915 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-46046e4b-39d1-4367-bfed-c4d8636b7d0e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:35.585017 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-46046e4b-39d1-4367-bfed-c4d8636b7d0e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:35.585484 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-46046e4b-39d1-4367-bfed-c4d8636b7d0e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:35.586306 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-46046e4b-39d1-4367-bfed-c4d8636b7d0e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:35.586843 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-46046e4b-39d1-4367-bfed-c4d8636b7d0e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:35.609306 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-a7770c15-f04b-472b-92c6-5af2405f8cb3 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:35.618038 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-a7770c15-f04b-472b-92c6-5af2405f8cb3 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/8ae91590-af1f-473b-9391-f77fe37593f2" status: 200 len: 1514 microversion: 2.1 time: 0.271954 Apr 30 13:20:35.618625 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 234/543] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:35 2021] GET /compute/v2.1/servers/8ae91590-af1f-473b-9391-f77fe37593f2 => generated 1514 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:35.813572 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-46046e4b-39d1-4367-bfed-c4d8636b7d0e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:35.825925 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-46046e4b-39d1-4367-bfed-c4d8636b7d0e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:35.828011 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-46046e4b-39d1-4367-bfed-c4d8636b7d0e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:35.829116 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-46046e4b-39d1-4367-bfed-c4d8636b7d0e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1806 microversion: 2.20 time: 0.257539 Apr 30 13:20:35.830207 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 310/544] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:20:35 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1806 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:20:36.635941 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-32c2142c-369d-4cd8-96ef-9813c4baa337 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:36.636590 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-32c2142c-369d-4cd8-96ef-9813c4baa337 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: 8ae91590-af1f-473b-9391-f77fe37593f2] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:36.644753 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-32c2142c-369d-4cd8-96ef-9813c4baa337 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:36.645213 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-32c2142c-369d-4cd8-96ef-9813c4baa337 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:36.646032 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-32c2142c-369d-4cd8-96ef-9813c4baa337 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:36.646495 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-32c2142c-369d-4cd8-96ef-9813c4baa337 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:36.848325 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-acf85a92-95b8-46d5-b799-5a716723a4be tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:36.848952 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-acf85a92-95b8-46d5-b799-5a716723a4be tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:36.858289 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-acf85a92-95b8-46d5-b799-5a716723a4be tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:36.858746 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-acf85a92-95b8-46d5-b799-5a716723a4be tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:36.864666 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-acf85a92-95b8-46d5-b799-5a716723a4be tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:36.865132 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-acf85a92-95b8-46d5-b799-5a716723a4be tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:36.914135 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-32c2142c-369d-4cd8-96ef-9813c4baa337 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:36.923482 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-32c2142c-369d-4cd8-96ef-9813c4baa337 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/8ae91590-af1f-473b-9391-f77fe37593f2" status: 200 len: 1514 microversion: 2.1 time: 0.291346 Apr 30 13:20:36.924162 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 235/545] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:36 2021] GET /compute/v2.1/servers/8ae91590-af1f-473b-9391-f77fe37593f2 => generated 1514 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:37.146617 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-acf85a92-95b8-46d5-b799-5a716723a4be tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:37.156545 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-acf85a92-95b8-46d5-b799-5a716723a4be tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:37.158510 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-acf85a92-95b8-46d5-b799-5a716723a4be tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:37.159672 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-acf85a92-95b8-46d5-b799-5a716723a4be tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1806 microversion: 2.20 time: 0.315966 Apr 30 13:20:37.160235 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 311/546] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:20:36 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1806 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:20:37.940505 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-660e97c8-1be2-4fc6-b8c8-c382f0ad581c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:37.941115 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-660e97c8-1be2-4fc6-b8c8-c382f0ad581c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: 8ae91590-af1f-473b-9391-f77fe37593f2] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:37.948506 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-660e97c8-1be2-4fc6-b8c8-c382f0ad581c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:37.948951 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-660e97c8-1be2-4fc6-b8c8-c382f0ad581c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:37.949841 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-660e97c8-1be2-4fc6-b8c8-c382f0ad581c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:37.950492 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-660e97c8-1be2-4fc6-b8c8-c382f0ad581c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:38.150904 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-df18e43b-f975-4795-86eb-b2fd2d55461e tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:38.152254 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-df18e43b-f975-4795-86eb-b2fd2d55461e tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 1a6ccbb4-3ad3-4ffa-b205-32968e961896] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:38.163013 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-df18e43b-f975-4795-86eb-b2fd2d55461e tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:38.163921 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-df18e43b-f975-4795-86eb-b2fd2d55461e tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:38.165729 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-df18e43b-f975-4795-86eb-b2fd2d55461e tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:38.166494 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-df18e43b-f975-4795-86eb-b2fd2d55461e tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:38.211905 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-660e97c8-1be2-4fc6-b8c8-c382f0ad581c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:38.231056 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-660e97c8-1be2-4fc6-b8c8-c382f0ad581c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/8ae91590-af1f-473b-9391-f77fe37593f2" status: 200 len: 1514 microversion: 2.1 time: 0.294232 Apr 30 13:20:38.238366 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 236/547] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:37 2021] GET /compute/v2.1/servers/8ae91590-af1f-473b-9391-f77fe37593f2 => generated 1514 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:38.247743 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-89deaab5-c28d-44e1-b7a3-df24022dba42 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:38.248589 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-89deaab5-c28d-44e1-b7a3-df24022dba42 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:38.260777 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-89deaab5-c28d-44e1-b7a3-df24022dba42 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:38.261664 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-89deaab5-c28d-44e1-b7a3-df24022dba42 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:38.265333 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-89deaab5-c28d-44e1-b7a3-df24022dba42 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:38.266530 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-89deaab5-c28d-44e1-b7a3-df24022dba42 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:38.283209 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-df18e43b-f975-4795-86eb-b2fd2d55461e tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 1a6ccbb4-3ad3-4ffa-b205-32968e961896] Going to try to terminate instance {{(pid=87933) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 13:20:38.463150 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-df18e43b-f975-4795-86eb-b2fd2d55461e tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "DELETE /compute/v2.1/servers/1a6ccbb4-3ad3-4ffa-b205-32968e961896" status: 204 len: 0 microversion: 2.1 time: 0.316056 Apr 30 13:20:38.463980 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 312/548] 10.222.0.79 () {58 vars in 1239 bytes} [Fri Apr 30 13:20:38 2021] DELETE /compute/v2.1/servers/1a6ccbb4-3ad3-4ffa-b205-32968e961896 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 13:20:38.473909 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-d5314f53-59b0-4196-916a-6814b4f877c8 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:38.474651 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-d5314f53-59b0-4196-916a-6814b4f877c8 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 1a6ccbb4-3ad3-4ffa-b205-32968e961896] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:38.483149 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d5314f53-59b0-4196-916a-6814b4f877c8 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:38.483820 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d5314f53-59b0-4196-916a-6814b4f877c8 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:38.484583 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d5314f53-59b0-4196-916a-6814b4f877c8 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:38.485020 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d5314f53-59b0-4196-916a-6814b4f877c8 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:38.557946 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-89deaab5-c28d-44e1-b7a3-df24022dba42 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:38.572959 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-89deaab5-c28d-44e1-b7a3-df24022dba42 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:38.574492 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-89deaab5-c28d-44e1-b7a3-df24022dba42 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:38.575817 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-89deaab5-c28d-44e1-b7a3-df24022dba42 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1806 microversion: 2.20 time: 0.335569 Apr 30 13:20:38.578119 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 237/549] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:20:38 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1806 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:20:38.709300 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-d5314f53-59b0-4196-916a-6814b4f877c8 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:38.717697 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-d5314f53-59b0-4196-916a-6814b4f877c8 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/1a6ccbb4-3ad3-4ffa-b205-32968e961896" status: 200 len: 1513 microversion: 2.1 time: 0.249000 Apr 30 13:20:38.718313 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 313/550] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:38 2021] GET /compute/v2.1/servers/1a6ccbb4-3ad3-4ffa-b205-32968e961896 => generated 1513 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:39.256357 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-cb956ad6-c98b-4eb4-906b-970ec06adb2c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:39.258235 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-cb956ad6-c98b-4eb4-906b-970ec06adb2c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: 8ae91590-af1f-473b-9391-f77fe37593f2] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:39.271455 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cb956ad6-c98b-4eb4-906b-970ec06adb2c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:39.272282 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cb956ad6-c98b-4eb4-906b-970ec06adb2c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:39.273719 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cb956ad6-c98b-4eb4-906b-970ec06adb2c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:39.274571 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cb956ad6-c98b-4eb4-906b-970ec06adb2c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:39.603876 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-3f650d09-fffb-4b44-a357-0f9cd5764619 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:39.605274 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-3f650d09-fffb-4b44-a357-0f9cd5764619 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:39.616075 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3f650d09-fffb-4b44-a357-0f9cd5764619 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:39.616638 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3f650d09-fffb-4b44-a357-0f9cd5764619 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:39.617530 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3f650d09-fffb-4b44-a357-0f9cd5764619 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:39.618110 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3f650d09-fffb-4b44-a357-0f9cd5764619 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:39.871229 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-3f650d09-fffb-4b44-a357-0f9cd5764619 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:39.881473 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-3f650d09-fffb-4b44-a357-0f9cd5764619 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:39.883275 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-3f650d09-fffb-4b44-a357-0f9cd5764619 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:39.884446 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-3f650d09-fffb-4b44-a357-0f9cd5764619 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1806 microversion: 2.20 time: 0.285169 Apr 30 13:20:39.885012 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 314/551] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:20:39 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1806 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:20:39.889891 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-92a7aa5c-8022-41a5-ae8b-f872b702f804 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:39.890761 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-92a7aa5c-8022-41a5-ae8b-f872b702f804 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 1a6ccbb4-3ad3-4ffa-b205-32968e961896] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:39.898591 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-92a7aa5c-8022-41a5-ae8b-f872b702f804 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:39.899052 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-92a7aa5c-8022-41a5-ae8b-f872b702f804 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:39.899861 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-92a7aa5c-8022-41a5-ae8b-f872b702f804 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:39.900306 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-92a7aa5c-8022-41a5-ae8b-f872b702f804 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:39.913275 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-cb956ad6-c98b-4eb4-906b-970ec06adb2c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:39.922513 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-cb956ad6-c98b-4eb4-906b-970ec06adb2c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/8ae91590-af1f-473b-9391-f77fe37593f2" status: 200 len: 1514 microversion: 2.1 time: 0.673713 Apr 30 13:20:39.923257 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 238/552] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:39 2021] GET /compute/v2.1/servers/8ae91590-af1f-473b-9391-f77fe37593f2 => generated 1514 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:40.114847 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-92a7aa5c-8022-41a5-ae8b-f872b702f804 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:40.123350 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-92a7aa5c-8022-41a5-ae8b-f872b702f804 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/1a6ccbb4-3ad3-4ffa-b205-32968e961896" status: 200 len: 1513 microversion: 2.1 time: 0.237159 Apr 30 13:20:40.123938 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 315/553] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:39 2021] GET /compute/v2.1/servers/1a6ccbb4-3ad3-4ffa-b205-32968e961896 => generated 1513 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:40.492695 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [req-27e4def2-8c2a-43ca-9a90-785913b016c8 req-ad736254-6ccd-42d8-aac5-dd55713105db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ae91590-af1f-473b-9391-f77fe37593f2", "name": "network-vif-deleted", "tag": "25347b02-eba4-4cb1-8902-90ae885f45d1"}]} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:20:40.494931 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:20:40.494931 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: warnings.warn(msg) Apr 30 13:20:40.505494 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-27e4def2-8c2a-43ca-9a90-785913b016c8 req-ad736254-6ccd-42d8-aac5-dd55713105db service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:40.506173 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-27e4def2-8c2a-43ca-9a90-785913b016c8 req-ad736254-6ccd-42d8-aac5-dd55713105db service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:40.524921 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.compute.server_external_events [req-27e4def2-8c2a-43ca-9a90-785913b016c8 req-ad736254-6ccd-42d8-aac5-dd55713105db service nova] Creating event network-vif-deleted:25347b02-eba4-4cb1-8902-90ae885f45d1 for instance 8ae91590-af1f-473b-9391-f77fe37593f2 on hv-cinder-78836 Apr 30 13:20:40.536932 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [req-27e4def2-8c2a-43ca-9a90-785913b016c8 req-ad736254-6ccd-42d8-aac5-dd55713105db service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047860 Apr 30 13:20:40.537707 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 239/554] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:20:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:20:40.906380 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-931e84a0-cb99-4205-90c4-7366da98eac5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:40.907214 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-931e84a0-cb99-4205-90c4-7366da98eac5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:40.910585 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-7e62753e-a497-4e8e-b2fe-a767847660ec tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:40.914068 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-7e62753e-a497-4e8e-b2fe-a767847660ec tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:40.919181 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-931e84a0-cb99-4205-90c4-7366da98eac5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:40.919692 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-931e84a0-cb99-4205-90c4-7366da98eac5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:40.920570 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-931e84a0-cb99-4205-90c4-7366da98eac5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:40.921235 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-931e84a0-cb99-4205-90c4-7366da98eac5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:40.924719 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7e62753e-a497-4e8e-b2fe-a767847660ec tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:40.925839 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7e62753e-a497-4e8e-b2fe-a767847660ec tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:40.927630 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7e62753e-a497-4e8e-b2fe-a767847660ec tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:40.928436 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7e62753e-a497-4e8e-b2fe-a767847660ec tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:41.000502 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-7e62753e-a497-4e8e-b2fe-a767847660ec tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Going to try to terminate instance {{(pid=87932) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 13:20:41.187916 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-7e62753e-a497-4e8e-b2fe-a767847660ec tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "DELETE /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 204 len: 0 microversion: 2.1 time: 0.281796 Apr 30 13:20:41.189312 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 240/555] 10.222.0.79 () {58 vars in 1239 bytes} [Fri Apr 30 13:20:40 2021] DELETE /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 30 13:20:41.199814 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-931e84a0-cb99-4205-90c4-7366da98eac5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:41.200355 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-73c6cbe7-867c-4f93-97c2-99422a5df8e3 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:41.201539 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-73c6cbe7-867c-4f93-97c2-99422a5df8e3 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: 8ae91590-af1f-473b-9391-f77fe37593f2] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:41.214049 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-931e84a0-cb99-4205-90c4-7366da98eac5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:41.216492 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-931e84a0-cb99-4205-90c4-7366da98eac5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:41.217129 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-73c6cbe7-867c-4f93-97c2-99422a5df8e3 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:41.217744 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-73c6cbe7-867c-4f93-97c2-99422a5df8e3 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:41.218286 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-931e84a0-cb99-4205-90c4-7366da98eac5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1806 microversion: 2.20 time: 0.317690 Apr 30 13:20:41.218582 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-73c6cbe7-867c-4f93-97c2-99422a5df8e3 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:41.219244 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-73c6cbe7-867c-4f93-97c2-99422a5df8e3 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:41.227512 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 316/556] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:20:40 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1806 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:20:41.233344 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-a6584c8a-8886-4162-bdff-a7c1d469acf6 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:41.234038 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-a6584c8a-8886-4162-bdff-a7c1d469acf6 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 1a6ccbb4-3ad3-4ffa-b205-32968e961896] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:41.243508 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a6584c8a-8886-4162-bdff-a7c1d469acf6 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:41.244053 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a6584c8a-8886-4162-bdff-a7c1d469acf6 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:41.244964 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a6584c8a-8886-4162-bdff-a7c1d469acf6 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:41.245623 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a6584c8a-8886-4162-bdff-a7c1d469acf6 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:41.304850 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-73c6cbe7-867c-4f93-97c2-99422a5df8e3 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:41.305327 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-73c6cbe7-867c-4f93-97c2-99422a5df8e3 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:41.305793 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.objects.instance [None req-73c6cbe7-867c-4f93-97c2-99422a5df8e3 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lazy-loading 'fault' on Instance uuid 8ae91590-af1f-473b-9391-f77fe37593f2 {{(pid=87932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:20:41.513500 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-73c6cbe7-867c-4f93-97c2-99422a5df8e3 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:41.527892 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-73c6cbe7-867c-4f93-97c2-99422a5df8e3 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/8ae91590-af1f-473b-9391-f77fe37593f2" status: 200 len: 1309 microversion: 2.1 time: 0.335254 Apr 30 13:20:41.539113 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 241/557] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:41 2021] GET /compute/v2.1/servers/8ae91590-af1f-473b-9391-f77fe37593f2 => generated 1309 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:41.546039 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-6df51eb1-f6a2-4dfe-8362-0df02fee0c5e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:41.547004 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-6df51eb1-f6a2-4dfe-8362-0df02fee0c5e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:41.561116 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6df51eb1-f6a2-4dfe-8362-0df02fee0c5e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:41.562135 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6df51eb1-f6a2-4dfe-8362-0df02fee0c5e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:41.563641 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6df51eb1-f6a2-4dfe-8362-0df02fee0c5e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:41.565919 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6df51eb1-f6a2-4dfe-8362-0df02fee0c5e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:41.614218 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-a6584c8a-8886-4162-bdff-a7c1d469acf6 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:41.636849 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-a6584c8a-8886-4162-bdff-a7c1d469acf6 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/1a6ccbb4-3ad3-4ffa-b205-32968e961896" status: 200 len: 1513 microversion: 2.1 time: 0.407069 Apr 30 13:20:41.637983 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 317/558] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:41 2021] GET /compute/v2.1/servers/1a6ccbb4-3ad3-4ffa-b205-32968e961896 => generated 1513 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:42.082767 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-6df51eb1-f6a2-4dfe-8362-0df02fee0c5e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:42.091169 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-6df51eb1-f6a2-4dfe-8362-0df02fee0c5e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1507 microversion: 2.1 time: 0.550877 Apr 30 13:20:42.092035 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 242/559] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:41 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1507 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:42.239032 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-8bb4388b-dec3-47ed-a566-d89e9ed763ed tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:42.240354 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-8bb4388b-dec3-47ed-a566-d89e9ed763ed tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:42.249846 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8bb4388b-dec3-47ed-a566-d89e9ed763ed tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:42.250940 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8bb4388b-dec3-47ed-a566-d89e9ed763ed tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:42.253244 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8bb4388b-dec3-47ed-a566-d89e9ed763ed tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:42.254138 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8bb4388b-dec3-47ed-a566-d89e9ed763ed tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:42.540764 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-8bb4388b-dec3-47ed-a566-d89e9ed763ed tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:42.550494 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-f273efba-46e8-4c2d-8b29-b45d5d5aaad5 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:42.551279 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-f273efba-46e8-4c2d-8b29-b45d5d5aaad5 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: 8ae91590-af1f-473b-9391-f77fe37593f2] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:42.554543 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-8bb4388b-dec3-47ed-a566-d89e9ed763ed tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:42.556535 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-8bb4388b-dec3-47ed-a566-d89e9ed763ed tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:42.558036 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-8bb4388b-dec3-47ed-a566-d89e9ed763ed tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1806 microversion: 2.20 time: 0.324502 Apr 30 13:20:42.559261 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f273efba-46e8-4c2d-8b29-b45d5d5aaad5 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:42.559724 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f273efba-46e8-4c2d-8b29-b45d5d5aaad5 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:42.563489 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f273efba-46e8-4c2d-8b29-b45d5d5aaad5 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:42.564195 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f273efba-46e8-4c2d-8b29-b45d5d5aaad5 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:42.570495 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 318/560] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:20:42 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1806 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:20:42.575543 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [req-2da0d277-c9e7-46f3-8c59-f339972f1593 req-30c4707a-1914-4ca5-8e19-ed0f2597cb16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a6ccbb4-3ad3-4ffa-b205-32968e961896", "name": "network-vif-deleted", "tag": "f5b457d3-15e2-4e12-a63e-4e6d1632b84c"}]} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:20:42.577133 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:20:42.577133 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: warnings.warn(msg) Apr 30 13:20:42.586028 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-2da0d277-c9e7-46f3-8c59-f339972f1593 req-30c4707a-1914-4ca5-8e19-ed0f2597cb16 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:42.586856 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-2da0d277-c9e7-46f3-8c59-f339972f1593 req-30c4707a-1914-4ca5-8e19-ed0f2597cb16 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:42.607191 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.compute.server_external_events [req-2da0d277-c9e7-46f3-8c59-f339972f1593 req-30c4707a-1914-4ca5-8e19-ed0f2597cb16 service nova] Creating event network-vif-deleted:f5b457d3-15e2-4e12-a63e-4e6d1632b84c for instance 1a6ccbb4-3ad3-4ffa-b205-32968e961896 on hv-cinder-78836 Apr 30 13:20:42.613252 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [req-2da0d277-c9e7-46f3-8c59-f339972f1593 req-30c4707a-1914-4ca5-8e19-ed0f2597cb16 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041094 Apr 30 13:20:42.614066 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 319/561] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:20:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:20:42.622574 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.wsgi [None req-f273efba-46e8-4c2d-8b29-b45d5d5aaad5 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] HTTP exception thrown: Instance 8ae91590-af1f-473b-9391-f77fe37593f2 could not be found. Apr 30 13:20:42.623184 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-f273efba-46e8-4c2d-8b29-b45d5d5aaad5 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Returning 404 to user: Instance 8ae91590-af1f-473b-9391-f77fe37593f2 could not be found. {{(pid=87932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:20:42.624022 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-f273efba-46e8-4c2d-8b29-b45d5d5aaad5 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/8ae91590-af1f-473b-9391-f77fe37593f2" status: 404 len: 111 microversion: 2.1 time: 0.079020 Apr 30 13:20:42.624738 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 243/562] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:42 2021] GET /compute/v2.1/servers/8ae91590-af1f-473b-9391-f77fe37593f2 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:20:42.663184 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-119a3088-270c-48ab-9d4b-11db6b2a628a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:42.664002 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-119a3088-270c-48ab-9d4b-11db6b2a628a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 1a6ccbb4-3ad3-4ffa-b205-32968e961896] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:42.674662 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-119a3088-270c-48ab-9d4b-11db6b2a628a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:42.675418 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-119a3088-270c-48ab-9d4b-11db6b2a628a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:42.676515 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-119a3088-270c-48ab-9d4b-11db6b2a628a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:42.677072 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-119a3088-270c-48ab-9d4b-11db6b2a628a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:42.760223 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-119a3088-270c-48ab-9d4b-11db6b2a628a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:42.761008 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-119a3088-270c-48ab-9d4b-11db6b2a628a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:42.761763 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.objects.instance [None req-119a3088-270c-48ab-9d4b-11db6b2a628a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lazy-loading 'fault' on Instance uuid 1a6ccbb4-3ad3-4ffa-b205-32968e961896 {{(pid=87933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:20:42.867522 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-119a3088-270c-48ab-9d4b-11db6b2a628a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:42.880805 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-119a3088-270c-48ab-9d4b-11db6b2a628a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/1a6ccbb4-3ad3-4ffa-b205-32968e961896" status: 200 len: 1307 microversion: 2.1 time: 0.222888 Apr 30 13:20:42.882267 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 320/563] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:42 2021] GET /compute/v2.1/servers/1a6ccbb4-3ad3-4ffa-b205-32968e961896 => generated 1307 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:43.112990 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-9f5e1cb5-050c-4574-9a37-6b005fcea7b4 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:43.113891 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-9f5e1cb5-050c-4574-9a37-6b005fcea7b4 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:43.122292 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9f5e1cb5-050c-4574-9a37-6b005fcea7b4 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:43.123059 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9f5e1cb5-050c-4574-9a37-6b005fcea7b4 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:43.124087 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9f5e1cb5-050c-4574-9a37-6b005fcea7b4 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:43.124717 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9f5e1cb5-050c-4574-9a37-6b005fcea7b4 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:43.356938 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-9f5e1cb5-050c-4574-9a37-6b005fcea7b4 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:43.365803 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-9f5e1cb5-050c-4574-9a37-6b005fcea7b4 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1507 microversion: 2.1 time: 0.259387 Apr 30 13:20:43.366427 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 244/564] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:43 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1507 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:43.577532 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-11c1fa7c-1c2d-4074-afc2-eb6e585fc4e7 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:43.579214 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-11c1fa7c-1c2d-4074-afc2-eb6e585fc4e7 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:43.593984 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-11c1fa7c-1c2d-4074-afc2-eb6e585fc4e7 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:43.594802 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-11c1fa7c-1c2d-4074-afc2-eb6e585fc4e7 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:43.596376 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-11c1fa7c-1c2d-4074-afc2-eb6e585fc4e7 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:43.597094 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-11c1fa7c-1c2d-4074-afc2-eb6e585fc4e7 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:43.819152 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-11c1fa7c-1c2d-4074-afc2-eb6e585fc4e7 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:43.832183 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-11c1fa7c-1c2d-4074-afc2-eb6e585fc4e7 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:43.834495 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-11c1fa7c-1c2d-4074-afc2-eb6e585fc4e7 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:43.836832 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-11c1fa7c-1c2d-4074-afc2-eb6e585fc4e7 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1806 microversion: 2.20 time: 0.263295 Apr 30 13:20:43.837989 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 321/565] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:20:43 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1806 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:20:43.903609 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-cd059188-80e8-4a8b-bec4-1257bbb5edfe tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:43.904943 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-cd059188-80e8-4a8b-bec4-1257bbb5edfe tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 1a6ccbb4-3ad3-4ffa-b205-32968e961896] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:43.914498 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cd059188-80e8-4a8b-bec4-1257bbb5edfe tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:43.915044 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cd059188-80e8-4a8b-bec4-1257bbb5edfe tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:43.915947 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cd059188-80e8-4a8b-bec4-1257bbb5edfe tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:43.916458 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cd059188-80e8-4a8b-bec4-1257bbb5edfe tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:43.967905 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.wsgi [None req-cd059188-80e8-4a8b-bec4-1257bbb5edfe tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] HTTP exception thrown: Instance 1a6ccbb4-3ad3-4ffa-b205-32968e961896 could not be found. Apr 30 13:20:43.968777 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-cd059188-80e8-4a8b-bec4-1257bbb5edfe tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Returning 404 to user: Instance 1a6ccbb4-3ad3-4ffa-b205-32968e961896 could not be found. {{(pid=87932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:20:43.969624 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-cd059188-80e8-4a8b-bec4-1257bbb5edfe tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/1a6ccbb4-3ad3-4ffa-b205-32968e961896" status: 404 len: 111 microversion: 2.1 time: 0.070010 Apr 30 13:20:43.970214 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 245/566] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:43 2021] GET /compute/v2.1/servers/1a6ccbb4-3ad3-4ffa-b205-32968e961896 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:20:44.383321 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-7085885d-3e63-4c33-b0ee-95dca283ab5c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:44.383845 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-7085885d-3e63-4c33-b0ee-95dca283ab5c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:44.391272 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7085885d-3e63-4c33-b0ee-95dca283ab5c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:44.391731 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7085885d-3e63-4c33-b0ee-95dca283ab5c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:44.392556 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7085885d-3e63-4c33-b0ee-95dca283ab5c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:44.393115 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7085885d-3e63-4c33-b0ee-95dca283ab5c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:44.605400 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-7085885d-3e63-4c33-b0ee-95dca283ab5c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:44.615017 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-7085885d-3e63-4c33-b0ee-95dca283ab5c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1507 microversion: 2.1 time: 0.235501 Apr 30 13:20:44.615603 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 322/567] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:44 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1507 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:44.855658 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-15f3e611-cd8e-47b9-b7a2-f009db47529b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:44.856279 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-15f3e611-cd8e-47b9-b7a2-f009db47529b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:44.864368 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-15f3e611-cd8e-47b9-b7a2-f009db47529b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:44.864826 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-15f3e611-cd8e-47b9-b7a2-f009db47529b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:44.865625 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-15f3e611-cd8e-47b9-b7a2-f009db47529b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:44.866096 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-15f3e611-cd8e-47b9-b7a2-f009db47529b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:45.068068 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-15f3e611-cd8e-47b9-b7a2-f009db47529b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:45.078136 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-15f3e611-cd8e-47b9-b7a2-f009db47529b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:45.079755 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-15f3e611-cd8e-47b9-b7a2-f009db47529b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:45.081641 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-15f3e611-cd8e-47b9-b7a2-f009db47529b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1806 microversion: 2.20 time: 0.229569 Apr 30 13:20:45.082376 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 246/568] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:20:44 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1806 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:20:45.632492 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-06e9e2f4-fe4a-434d-9336-e5875e8f02bb tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:45.633037 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-06e9e2f4-fe4a-434d-9336-e5875e8f02bb tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:45.640601 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-06e9e2f4-fe4a-434d-9336-e5875e8f02bb tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:45.641055 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-06e9e2f4-fe4a-434d-9336-e5875e8f02bb tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:45.641835 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-06e9e2f4-fe4a-434d-9336-e5875e8f02bb tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:45.642451 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-06e9e2f4-fe4a-434d-9336-e5875e8f02bb tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:45.843815 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-06e9e2f4-fe4a-434d-9336-e5875e8f02bb tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:45.853099 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-06e9e2f4-fe4a-434d-9336-e5875e8f02bb tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1507 microversion: 2.1 time: 0.224382 Apr 30 13:20:45.853685 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 323/569] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:45 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1507 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:46.100602 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-1574d172-28dd-424d-a0e5-9054922cd228 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:46.101218 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-1574d172-28dd-424d-a0e5-9054922cd228 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:46.109606 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1574d172-28dd-424d-a0e5-9054922cd228 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:46.110168 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1574d172-28dd-424d-a0e5-9054922cd228 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:46.111035 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1574d172-28dd-424d-a0e5-9054922cd228 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:46.112077 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1574d172-28dd-424d-a0e5-9054922cd228 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:46.387539 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-1574d172-28dd-424d-a0e5-9054922cd228 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:46.396681 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-1574d172-28dd-424d-a0e5-9054922cd228 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:46.398216 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-1574d172-28dd-424d-a0e5-9054922cd228 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:46.399399 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-1574d172-28dd-424d-a0e5-9054922cd228 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1806 microversion: 2.20 time: 0.302645 Apr 30 13:20:46.399951 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 247/570] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:20:46 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1806 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:20:46.877175 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-ea786f35-8f22-41e6-ba2d-d44aa1583e12 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:46.877846 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-ea786f35-8f22-41e6-ba2d-d44aa1583e12 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:46.886373 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ea786f35-8f22-41e6-ba2d-d44aa1583e12 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:46.887024 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ea786f35-8f22-41e6-ba2d-d44aa1583e12 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:46.887904 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ea786f35-8f22-41e6-ba2d-d44aa1583e12 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:46.888346 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ea786f35-8f22-41e6-ba2d-d44aa1583e12 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:47.190238 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-ea786f35-8f22-41e6-ba2d-d44aa1583e12 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:47.198517 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-ea786f35-8f22-41e6-ba2d-d44aa1583e12 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1507 microversion: 2.1 time: 0.325135 Apr 30 13:20:47.199266 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 324/571] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:46 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1507 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:47.417980 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-3c5f1a4c-2ed0-4f7b-9ab5-eb37187aed2c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:47.419310 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-3c5f1a4c-2ed0-4f7b-9ab5-eb37187aed2c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:47.427139 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3c5f1a4c-2ed0-4f7b-9ab5-eb37187aed2c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:47.427673 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3c5f1a4c-2ed0-4f7b-9ab5-eb37187aed2c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:47.428481 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3c5f1a4c-2ed0-4f7b-9ab5-eb37187aed2c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:47.428925 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3c5f1a4c-2ed0-4f7b-9ab5-eb37187aed2c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:48.043467 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-3c5f1a4c-2ed0-4f7b-9ab5-eb37187aed2c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:48.053076 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-3c5f1a4c-2ed0-4f7b-9ab5-eb37187aed2c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:48.054963 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-3c5f1a4c-2ed0-4f7b-9ab5-eb37187aed2c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:48.056139 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-3c5f1a4c-2ed0-4f7b-9ab5-eb37187aed2c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1806 microversion: 2.20 time: 0.641963 Apr 30 13:20:48.056698 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 248/572] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:20:47 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1806 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:20:48.216187 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-4972b7c7-ccb9-49ed-ade8-59257a11061c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:48.216835 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-4972b7c7-ccb9-49ed-ade8-59257a11061c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:48.226574 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4972b7c7-ccb9-49ed-ade8-59257a11061c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:48.233077 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4972b7c7-ccb9-49ed-ade8-59257a11061c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:48.233077 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4972b7c7-ccb9-49ed-ade8-59257a11061c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:48.233077 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4972b7c7-ccb9-49ed-ade8-59257a11061c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:48.540591 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-4972b7c7-ccb9-49ed-ade8-59257a11061c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:48.555057 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-4972b7c7-ccb9-49ed-ade8-59257a11061c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1507 microversion: 2.1 time: 0.341972 Apr 30 13:20:48.557448 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 325/573] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:48 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1507 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:48.579361 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-ace90958-dc61-45b0-b4c0-7beb95cdabb8 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:48.580684 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-ace90958-dc61-45b0-b4c0-7beb95cdabb8 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 93d74a82-eb0b-4b65-bbe2-8960312e9dd8] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:48.599026 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ace90958-dc61-45b0-b4c0-7beb95cdabb8 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:48.599485 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ace90958-dc61-45b0-b4c0-7beb95cdabb8 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:48.601253 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ace90958-dc61-45b0-b4c0-7beb95cdabb8 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:48.605567 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ace90958-dc61-45b0-b4c0-7beb95cdabb8 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:48.757629 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-ace90958-dc61-45b0-b4c0-7beb95cdabb8 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 93d74a82-eb0b-4b65-bbe2-8960312e9dd8] Going to try to terminate instance {{(pid=87932) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 13:20:48.952924 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [req-81baac2c-2b84-4f68-88f6-96db963949b0 req-f536e100-eb3f-42b3-a3ea-8e1e888f2ccf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c5fb2f8-696c-48e0-a4f2-c8410fec693f", "name": "network-vif-deleted", "tag": "3bf7253a-ca9c-4a79-b9c4-d8404a9e675d"}]} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:20:48.955153 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:20:48.955153 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: warnings.warn(msg) Apr 30 13:20:48.966804 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-81baac2c-2b84-4f68-88f6-96db963949b0 req-f536e100-eb3f-42b3-a3ea-8e1e888f2ccf service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:48.967267 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-81baac2c-2b84-4f68-88f6-96db963949b0 req-f536e100-eb3f-42b3-a3ea-8e1e888f2ccf service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:49.006085 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-ace90958-dc61-45b0-b4c0-7beb95cdabb8 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "DELETE /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8" status: 204 len: 0 microversion: 2.1 time: 0.429984 Apr 30 13:20:49.009667 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.compute.server_external_events [req-81baac2c-2b84-4f68-88f6-96db963949b0 req-f536e100-eb3f-42b3-a3ea-8e1e888f2ccf service nova] Creating event network-vif-deleted:3bf7253a-ca9c-4a79-b9c4-d8404a9e675d for instance 5c5fb2f8-696c-48e0-a4f2-c8410fec693f on hv-cinder-78836 Apr 30 13:20:49.010049 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 249/574] 10.222.0.79 () {58 vars in 1239 bytes} [Fri Apr 30 13:20:48 2021] DELETE /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 13:20:49.016654 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-d2ff4698-5a40-4b4c-8ee9-fbc8e5b2aafe tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:49.020682 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-d2ff4698-5a40-4b4c-8ee9-fbc8e5b2aafe tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 93d74a82-eb0b-4b65-bbe2-8960312e9dd8] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:49.021312 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [req-81baac2c-2b84-4f68-88f6-96db963949b0 req-f536e100-eb3f-42b3-a3ea-8e1e888f2ccf service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076228 Apr 30 13:20:49.023003 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 326/575] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:20:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Apr 30 13:20:49.050897 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d2ff4698-5a40-4b4c-8ee9-fbc8e5b2aafe tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:49.051905 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d2ff4698-5a40-4b4c-8ee9-fbc8e5b2aafe tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:49.053428 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d2ff4698-5a40-4b4c-8ee9-fbc8e5b2aafe tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:49.054312 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d2ff4698-5a40-4b4c-8ee9-fbc8e5b2aafe tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:49.078237 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b7f7f2d6-dfff-49b5-b37e-c879a5061d7a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:49.079066 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-b7f7f2d6-dfff-49b5-b37e-c879a5061d7a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:49.089587 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b7f7f2d6-dfff-49b5-b37e-c879a5061d7a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:49.090773 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b7f7f2d6-dfff-49b5-b37e-c879a5061d7a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:49.092360 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b7f7f2d6-dfff-49b5-b37e-c879a5061d7a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:49.093516 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b7f7f2d6-dfff-49b5-b37e-c879a5061d7a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:49.331109 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-b7f7f2d6-dfff-49b5-b37e-c879a5061d7a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:49.334504 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-d2ff4698-5a40-4b4c-8ee9-fbc8e5b2aafe tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:49.340915 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-b7f7f2d6-dfff-49b5-b37e-c879a5061d7a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:49.342909 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-b7f7f2d6-dfff-49b5-b37e-c879a5061d7a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:49.344375 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b7f7f2d6-dfff-49b5-b37e-c879a5061d7a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1806 microversion: 2.20 time: 0.271385 Apr 30 13:20:49.344769 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-d2ff4698-5a40-4b4c-8ee9-fbc8e5b2aafe tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8" status: 200 len: 1514 microversion: 2.1 time: 0.333223 Apr 30 13:20:49.346220 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 327/576] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:20:49 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1806 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:20:49.356429 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 250/577] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:49 2021] GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8 => generated 1514 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:49.399060 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [req-8be8cb18-5a43-4cd5-b0dc-909dff6db2f9 req-77fcfe4f-4a55-4cf5-9bea-1f90f1049bf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad3419a7-71af-4a52-bcb7-6048e0553df9", "name": "network-vif-plugged", "status": "completed", "tag": "d3c715c3-b0fe-400d-89f5-80c09379ea24"}]} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:20:49.401071 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:20:49.401071 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: warnings.warn(msg) Apr 30 13:20:49.412140 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-8be8cb18-5a43-4cd5-b0dc-909dff6db2f9 req-77fcfe4f-4a55-4cf5-9bea-1f90f1049bf6 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:49.412685 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-8be8cb18-5a43-4cd5-b0dc-909dff6db2f9 req-77fcfe4f-4a55-4cf5-9bea-1f90f1049bf6 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:49.431446 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.compute.server_external_events [req-8be8cb18-5a43-4cd5-b0dc-909dff6db2f9 req-77fcfe4f-4a55-4cf5-9bea-1f90f1049bf6 service nova] Creating event network-vif-plugged:d3c715c3-b0fe-400d-89f5-80c09379ea24 for instance ad3419a7-71af-4a52-bcb7-6048e0553df9 on hv-cinder-78836 Apr 30 13:20:49.436465 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [req-8be8cb18-5a43-4cd5-b0dc-909dff6db2f9 req-77fcfe4f-4a55-4cf5-9bea-1f90f1049bf6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041841 Apr 30 13:20:49.437224 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 328/578] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:20:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:20:49.577976 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-dd5b6b76-703d-48b6-9b56-89375ab3337d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:49.578978 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-dd5b6b76-703d-48b6-9b56-89375ab3337d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:49.587284 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-dd5b6b76-703d-48b6-9b56-89375ab3337d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:49.588518 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-dd5b6b76-703d-48b6-9b56-89375ab3337d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:49.589512 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-dd5b6b76-703d-48b6-9b56-89375ab3337d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:49.590187 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-dd5b6b76-703d-48b6-9b56-89375ab3337d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:49.664412 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-dd5b6b76-703d-48b6-9b56-89375ab3337d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:49.664865 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-dd5b6b76-703d-48b6-9b56-89375ab3337d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:49.665319 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.objects.instance [None req-dd5b6b76-703d-48b6-9b56-89375ab3337d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lazy-loading 'fault' on Instance uuid 5c5fb2f8-696c-48e0-a4f2-c8410fec693f {{(pid=87932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:20:49.748291 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-dd5b6b76-703d-48b6-9b56-89375ab3337d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:49.756796 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-dd5b6b76-703d-48b6-9b56-89375ab3337d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 200 len: 1312 microversion: 2.1 time: 0.184422 Apr 30 13:20:49.757377 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 251/579] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:49 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 1312 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:50.364139 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-598d8393-9626-43fa-80fb-9b8935c07595 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:50.365043 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-598d8393-9626-43fa-80fb-9b8935c07595 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:50.373652 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-598d8393-9626-43fa-80fb-9b8935c07595 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:50.374157 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-598d8393-9626-43fa-80fb-9b8935c07595 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:50.374613 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-af9652cb-2935-445f-bd14-59a8b5381d81 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:50.375138 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-598d8393-9626-43fa-80fb-9b8935c07595 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:50.375246 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-af9652cb-2935-445f-bd14-59a8b5381d81 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 93d74a82-eb0b-4b65-bbe2-8960312e9dd8] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:50.375595 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-598d8393-9626-43fa-80fb-9b8935c07595 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:50.383212 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-af9652cb-2935-445f-bd14-59a8b5381d81 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:50.383671 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-af9652cb-2935-445f-bd14-59a8b5381d81 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:50.384475 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-af9652cb-2935-445f-bd14-59a8b5381d81 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:50.384920 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-af9652cb-2935-445f-bd14-59a8b5381d81 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:50.613326 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-598d8393-9626-43fa-80fb-9b8935c07595 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:50.627196 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-598d8393-9626-43fa-80fb-9b8935c07595 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:50.630221 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-598d8393-9626-43fa-80fb-9b8935c07595 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:50.644332 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-598d8393-9626-43fa-80fb-9b8935c07595 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1806 microversion: 2.20 time: 0.284844 Apr 30 13:20:50.655068 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 329/580] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:20:50 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1806 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:20:50.675017 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-af9652cb-2935-445f-bd14-59a8b5381d81 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:50.684441 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-af9652cb-2935-445f-bd14-59a8b5381d81 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8" status: 200 len: 1514 microversion: 2.1 time: 0.314282 Apr 30 13:20:50.685028 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 252/581] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:50 2021] GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8 => generated 1514 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:20:50.774762 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-a9b6afdc-0b17-411a-949c-fd0251f5c38c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:50.775427 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-a9b6afdc-0b17-411a-949c-fd0251f5c38c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: 5c5fb2f8-696c-48e0-a4f2-c8410fec693f] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:50.783940 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a9b6afdc-0b17-411a-949c-fd0251f5c38c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:50.784514 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a9b6afdc-0b17-411a-949c-fd0251f5c38c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:50.785396 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a9b6afdc-0b17-411a-949c-fd0251f5c38c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:50.786295 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a9b6afdc-0b17-411a-949c-fd0251f5c38c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:50.839939 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.wsgi [None req-a9b6afdc-0b17-411a-949c-fd0251f5c38c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] HTTP exception thrown: Instance 5c5fb2f8-696c-48e0-a4f2-c8410fec693f could not be found. Apr 30 13:20:50.840549 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-a9b6afdc-0b17-411a-949c-fd0251f5c38c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Returning 404 to user: Instance 5c5fb2f8-696c-48e0-a4f2-c8410fec693f could not be found. {{(pid=87933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:20:50.841401 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-a9b6afdc-0b17-411a-949c-fd0251f5c38c tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f" status: 404 len: 111 microversion: 2.1 time: 0.070495 Apr 30 13:20:50.841980 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 330/582] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:50 2021] GET /compute/v2.1/servers/5c5fb2f8-696c-48e0-a4f2-c8410fec693f => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 13:20:50.851276 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-dbd611c1-e4b4-4395-8c4c-fef51c08be81 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:50.851784 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-dbd611c1-e4b4-4395-8c4c-fef51c08be81 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:50.860133 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-dbd611c1-e4b4-4395-8c4c-fef51c08be81 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:50.860589 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-dbd611c1-e4b4-4395-8c4c-fef51c08be81 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:50.861591 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-dbd611c1-e4b4-4395-8c4c-fef51c08be81 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:50.862414 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-dbd611c1-e4b4-4395-8c4c-fef51c08be81 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:50.928170 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-dbd611c1-e4b4-4395-8c4c-fef51c08be81 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Going to try to terminate instance {{(pid=87932) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 13:20:51.047054 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-dbd611c1-e4b4-4395-8c4c-fef51c08be81 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "DELETE /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 204 len: 0 microversion: 2.1 time: 0.199375 Apr 30 13:20:51.047643 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 253/583] 10.222.0.79 () {58 vars in 1239 bytes} [Fri Apr 30 13:20:50 2021] DELETE /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 13:20:51.056411 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-63c6c07d-69ee-4704-8255-21c519b63b3d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:51.057040 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-63c6c07d-69ee-4704-8255-21c519b63b3d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:51.065366 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-63c6c07d-69ee-4704-8255-21c519b63b3d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:51.065889 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-63c6c07d-69ee-4704-8255-21c519b63b3d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:51.066740 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-63c6c07d-69ee-4704-8255-21c519b63b3d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:51.067192 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-63c6c07d-69ee-4704-8255-21c519b63b3d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:51.278885 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-63c6c07d-69ee-4704-8255-21c519b63b3d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:51.288143 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-63c6c07d-69ee-4704-8255-21c519b63b3d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1520 microversion: 2.1 time: 0.235394 Apr 30 13:20:51.288730 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 331/584] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:51 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1520 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:20:51.664679 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-f0c6e905-b7e5-4504-8397-e404de9f3a8f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:51.665296 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-f0c6e905-b7e5-4504-8397-e404de9f3a8f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:51.672959 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f0c6e905-b7e5-4504-8397-e404de9f3a8f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:51.673411 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f0c6e905-b7e5-4504-8397-e404de9f3a8f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:51.675539 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f0c6e905-b7e5-4504-8397-e404de9f3a8f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:51.676094 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f0c6e905-b7e5-4504-8397-e404de9f3a8f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:51.700850 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-a1e3dbf3-7509-44c5-a1ed-97e2dc6e7de9 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:51.701624 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-a1e3dbf3-7509-44c5-a1ed-97e2dc6e7de9 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 93d74a82-eb0b-4b65-bbe2-8960312e9dd8] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:51.710796 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a1e3dbf3-7509-44c5-a1ed-97e2dc6e7de9 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:51.710796 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a1e3dbf3-7509-44c5-a1ed-97e2dc6e7de9 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:51.710796 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a1e3dbf3-7509-44c5-a1ed-97e2dc6e7de9 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:51.711502 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a1e3dbf3-7509-44c5-a1ed-97e2dc6e7de9 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:51.888887 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-f0c6e905-b7e5-4504-8397-e404de9f3a8f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:51.901494 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-f0c6e905-b7e5-4504-8397-e404de9f3a8f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:51.903078 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-f0c6e905-b7e5-4504-8397-e404de9f3a8f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:51.904284 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-f0c6e905-b7e5-4504-8397-e404de9f3a8f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1806 microversion: 2.20 time: 0.244592 Apr 30 13:20:51.904890 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 254/585] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:20:51 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1806 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:20:51.920682 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-a1e3dbf3-7509-44c5-a1ed-97e2dc6e7de9 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:51.929736 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-a1e3dbf3-7509-44c5-a1ed-97e2dc6e7de9 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8" status: 200 len: 1514 microversion: 2.1 time: 0.233037 Apr 30 13:20:51.930323 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 332/586] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:51 2021] GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8 => generated 1514 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:20:52.305645 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-42235cdf-d6d9-41b6-8d37-fd56af9c0e74 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:52.306288 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-42235cdf-d6d9-41b6-8d37-fd56af9c0e74 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:52.314033 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-42235cdf-d6d9-41b6-8d37-fd56af9c0e74 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:52.314630 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-42235cdf-d6d9-41b6-8d37-fd56af9c0e74 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:52.315651 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-42235cdf-d6d9-41b6-8d37-fd56af9c0e74 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:52.316087 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-42235cdf-d6d9-41b6-8d37-fd56af9c0e74 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:52.525790 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-42235cdf-d6d9-41b6-8d37-fd56af9c0e74 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:52.534936 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-42235cdf-d6d9-41b6-8d37-fd56af9c0e74 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1520 microversion: 2.1 time: 0.232939 Apr 30 13:20:52.535603 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 255/587] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:52 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1520 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:52.923171 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-a46fe3be-38da-41cd-91d3-cb8a3406eeb0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:52.923931 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-a46fe3be-38da-41cd-91d3-cb8a3406eeb0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:52.931380 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a46fe3be-38da-41cd-91d3-cb8a3406eeb0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:52.931831 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a46fe3be-38da-41cd-91d3-cb8a3406eeb0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:52.932612 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a46fe3be-38da-41cd-91d3-cb8a3406eeb0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:52.933047 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a46fe3be-38da-41cd-91d3-cb8a3406eeb0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:52.946587 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-19cbbcc9-53e5-4733-a9f7-eafb95c623aa tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:52.947254 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-19cbbcc9-53e5-4733-a9f7-eafb95c623aa tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 93d74a82-eb0b-4b65-bbe2-8960312e9dd8] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:52.955853 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-19cbbcc9-53e5-4733-a9f7-eafb95c623aa tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:52.956365 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-19cbbcc9-53e5-4733-a9f7-eafb95c623aa tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:52.957100 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-19cbbcc9-53e5-4733-a9f7-eafb95c623aa tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:52.957576 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-19cbbcc9-53e5-4733-a9f7-eafb95c623aa tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:53.142970 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-a46fe3be-38da-41cd-91d3-cb8a3406eeb0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:53.152703 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-a46fe3be-38da-41cd-91d3-cb8a3406eeb0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:53.154260 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-a46fe3be-38da-41cd-91d3-cb8a3406eeb0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:53.155413 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-a46fe3be-38da-41cd-91d3-cb8a3406eeb0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1806 microversion: 2.20 time: 0.236077 Apr 30 13:20:53.155976 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 333/588] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:20:52 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1806 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:20:53.164497 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-19cbbcc9-53e5-4733-a9f7-eafb95c623aa tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:53.172962 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-19cbbcc9-53e5-4733-a9f7-eafb95c623aa tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8" status: 200 len: 1514 microversion: 2.1 time: 0.230192 Apr 30 13:20:53.174264 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 256/589] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:52 2021] GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8 => generated 1514 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:20:53.554083 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-27cd26ff-d79b-4721-9d47-1322c26dbc48 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:53.554824 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-27cd26ff-d79b-4721-9d47-1322c26dbc48 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:53.562654 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-27cd26ff-d79b-4721-9d47-1322c26dbc48 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:53.563205 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-27cd26ff-d79b-4721-9d47-1322c26dbc48 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:53.564082 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-27cd26ff-d79b-4721-9d47-1322c26dbc48 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:53.564570 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-27cd26ff-d79b-4721-9d47-1322c26dbc48 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:53.774100 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-27cd26ff-d79b-4721-9d47-1322c26dbc48 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:53.782655 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-27cd26ff-d79b-4721-9d47-1322c26dbc48 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1520 microversion: 2.1 time: 0.233654 Apr 30 13:20:53.783336 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 334/590] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:53 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1520 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:54.175374 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-c0d83d84-2c32-4eb2-afa3-9511b86144df tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:54.176047 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-c0d83d84-2c32-4eb2-afa3-9511b86144df tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:54.183817 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c0d83d84-2c32-4eb2-afa3-9511b86144df tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:54.184266 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c0d83d84-2c32-4eb2-afa3-9511b86144df tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:54.185247 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c0d83d84-2c32-4eb2-afa3-9511b86144df tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:54.185687 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c0d83d84-2c32-4eb2-afa3-9511b86144df tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:54.190556 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-259ebe5c-4879-4a1a-a715-c88d2c81ed90 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:54.191507 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-259ebe5c-4879-4a1a-a715-c88d2c81ed90 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 93d74a82-eb0b-4b65-bbe2-8960312e9dd8] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:54.201634 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-259ebe5c-4879-4a1a-a715-c88d2c81ed90 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:54.202230 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-259ebe5c-4879-4a1a-a715-c88d2c81ed90 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:54.203100 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-259ebe5c-4879-4a1a-a715-c88d2c81ed90 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:54.203833 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-259ebe5c-4879-4a1a-a715-c88d2c81ed90 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:54.397109 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-c0d83d84-2c32-4eb2-afa3-9511b86144df tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:54.407219 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-c0d83d84-2c32-4eb2-afa3-9511b86144df tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:54.408772 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-c0d83d84-2c32-4eb2-afa3-9511b86144df tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:54.409955 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-c0d83d84-2c32-4eb2-afa3-9511b86144df tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1806 microversion: 2.20 time: 0.239066 Apr 30 13:20:54.410560 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 257/591] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:20:54 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1806 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:20:54.417210 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-259ebe5c-4879-4a1a-a715-c88d2c81ed90 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:54.433756 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-259ebe5c-4879-4a1a-a715-c88d2c81ed90 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8" status: 200 len: 1514 microversion: 2.1 time: 0.247482 Apr 30 13:20:54.434900 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 335/592] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:54 2021] GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8 => generated 1514 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:20:54.570095 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-36d099ff-50e5-4482-80e3-58dcc3bf3967 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1242131003", "imageRef": "705a0c6b-b003-4687-84bf-8b9f87dae39e", "flavorRef": "452", "networks": [{"uuid": "b08e9f30-22e3-4606-a3ee-bc90a0d6aebb"}]}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:20:54.639378 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.network.neutron [None req-36d099ff-50e5-4482-80e3-58dcc3bf3967 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] validate_networks() for [('b08e9f30-22e3-4606-a3ee-bc90a0d6aebb', None, None, None)] {{(pid=87932) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 13:20:54.801314 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-a41827eb-0589-4746-9099-62d9262f4df8 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:54.801930 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-a41827eb-0589-4746-9099-62d9262f4df8 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:54.809998 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a41827eb-0589-4746-9099-62d9262f4df8 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:54.810544 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a41827eb-0589-4746-9099-62d9262f4df8 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:54.811342 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a41827eb-0589-4746-9099-62d9262f4df8 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:54.811782 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a41827eb-0589-4746-9099-62d9262f4df8 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:55.068003 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-a41827eb-0589-4746-9099-62d9262f4df8 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:55.077416 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-a41827eb-0589-4746-9099-62d9262f4df8 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1520 microversion: 2.1 time: 0.280722 Apr 30 13:20:55.078393 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 336/593] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:54 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1520 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:20:55.249544 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-36d099ff-50e5-4482-80e3-58dcc3bf3967 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Flavor limits 0:0:0 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 13:20:55.250109 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-36d099ff-50e5-4482-80e3-58dcc3bf3967 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Image limits 0:0:0 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 13:20:55.250703 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-36d099ff-50e5-4482-80e3-58dcc3bf3967 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Flavor pref 0:0:0 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 13:20:55.251226 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-36d099ff-50e5-4482-80e3-58dcc3bf3967 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Image pref 0:0:0 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 13:20:55.252345 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-36d099ff-50e5-4482-80e3-58dcc3bf3967 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 13:20:55.262338 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-36d099ff-50e5-4482-80e3-58dcc3bf3967 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:55.263051 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-36d099ff-50e5-4482-80e3-58dcc3bf3967 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:55.263991 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-36d099ff-50e5-4482-80e3-58dcc3bf3967 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:55.264711 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-36d099ff-50e5-4482-80e3-58dcc3bf3967 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:55.286517 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.quota [None req-36d099ff-50e5-4482-80e3-58dcc3bf3967 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Getting quotas for project 073a579db08449979c1fefb12078f6e9. Resources: {'ram', 'instances', 'cores'} {{(pid=87932) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:20:55.291239 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.quota [None req-36d099ff-50e5-4482-80e3-58dcc3bf3967 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Getting quotas for user 3e5f5b2ef3b243a5b503e95083c50449 and project 073a579db08449979c1fefb12078f6e9. Resources: {'ram', 'instances', 'cores'} {{(pid=87932) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:20:55.304563 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-36d099ff-50e5-4482-80e3-58dcc3bf3967 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Going to run 1 instances... {{(pid=87932) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 13:20:55.309851 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-36d099ff-50e5-4482-80e3-58dcc3bf3967 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='705a0c6b-b003-4687-84bf-8b9f87dae39e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=87932) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 13:20:55.360678 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-36d099ff-50e5-4482-80e3-58dcc3bf3967 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.794184 Apr 30 13:20:55.361781 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 258/594] 10.222.0.79 () {60 vars in 1147 bytes} [Fri Apr 30 13:20:54 2021] POST /compute/v2.1/servers => generated 380 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 13:20:55.372046 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-768d7bc7-203a-4fb4-ab36-006eea74105a tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:55.372845 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-768d7bc7-203a-4fb4-ab36-006eea74105a tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:55.441105 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-c1948627-e0ce-4cb8-a217-2d39e1b42f9b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:55.442831 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-c1948627-e0ce-4cb8-a217-2d39e1b42f9b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:55.467380 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c1948627-e0ce-4cb8-a217-2d39e1b42f9b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:55.468580 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c1948627-e0ce-4cb8-a217-2d39e1b42f9b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:55.470371 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c1948627-e0ce-4cb8-a217-2d39e1b42f9b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:55.471009 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c1948627-e0ce-4cb8-a217-2d39e1b42f9b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:55.486218 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-768d7bc7-203a-4fb4-ab36-006eea74105a tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:55.497445 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-768d7bc7-203a-4fb4-ab36-006eea74105a tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1219 microversion: 2.1 time: 0.129141 Apr 30 13:20:55.498927 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 337/595] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:55 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1219 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:55.505918 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-e08878a5-325a-438b-9cc8-1f74b6310aac tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:55.506907 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-e08878a5-325a-438b-9cc8-1f74b6310aac tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 93d74a82-eb0b-4b65-bbe2-8960312e9dd8] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:55.523257 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e08878a5-325a-438b-9cc8-1f74b6310aac tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:55.524363 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e08878a5-325a-438b-9cc8-1f74b6310aac tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:55.525763 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e08878a5-325a-438b-9cc8-1f74b6310aac tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:55.526893 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e08878a5-325a-438b-9cc8-1f74b6310aac tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:55.836946 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-e08878a5-325a-438b-9cc8-1f74b6310aac tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:55.851360 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-e08878a5-325a-438b-9cc8-1f74b6310aac tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8" status: 200 len: 1514 microversion: 2.1 time: 0.350715 Apr 30 13:20:55.852164 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 338/596] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:55 2021] GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8 => generated 1514 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:55.947169 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-c1948627-e0ce-4cb8-a217-2d39e1b42f9b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:55.967632 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-c1948627-e0ce-4cb8-a217-2d39e1b42f9b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:55.972276 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-c1948627-e0ce-4cb8-a217-2d39e1b42f9b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:55.976334 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-c1948627-e0ce-4cb8-a217-2d39e1b42f9b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1806 microversion: 2.20 time: 0.541049 Apr 30 13:20:55.977758 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 259/597] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:20:55 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1806 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:20:56.095832 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-c1885a69-0d09-4ad3-a64c-e4bbefbd99bf tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:56.096851 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-c1885a69-0d09-4ad3-a64c-e4bbefbd99bf tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:56.106678 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c1885a69-0d09-4ad3-a64c-e4bbefbd99bf tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:56.107718 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c1885a69-0d09-4ad3-a64c-e4bbefbd99bf tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:56.109017 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c1885a69-0d09-4ad3-a64c-e4bbefbd99bf tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:56.109819 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c1885a69-0d09-4ad3-a64c-e4bbefbd99bf tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:56.414679 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-c1885a69-0d09-4ad3-a64c-e4bbefbd99bf tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:56.427045 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-c1885a69-0d09-4ad3-a64c-e4bbefbd99bf tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1520 microversion: 2.1 time: 0.335035 Apr 30 13:20:56.444407 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 339/598] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:56 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1520 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:56.520829 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-b4f7fc86-e5b6-40a1-9991-de6ec39380e7 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:56.521615 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-b4f7fc86-e5b6-40a1-9991-de6ec39380e7 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:56.529656 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b4f7fc86-e5b6-40a1-9991-de6ec39380e7 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:56.530287 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b4f7fc86-e5b6-40a1-9991-de6ec39380e7 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:56.531202 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b4f7fc86-e5b6-40a1-9991-de6ec39380e7 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:56.531746 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b4f7fc86-e5b6-40a1-9991-de6ec39380e7 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:56.666187 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-b4f7fc86-e5b6-40a1-9991-de6ec39380e7 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:56.675423 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-b4f7fc86-e5b6-40a1-9991-de6ec39380e7 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1271 microversion: 2.1 time: 0.158702 Apr 30 13:20:56.676102 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 260/599] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:56 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1271 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:20:56.872614 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-d8645000-13a7-422e-be26-2823acd651c5 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:56.873993 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-d8645000-13a7-422e-be26-2823acd651c5 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 93d74a82-eb0b-4b65-bbe2-8960312e9dd8] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:56.889720 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d8645000-13a7-422e-be26-2823acd651c5 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:56.890615 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d8645000-13a7-422e-be26-2823acd651c5 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:56.891969 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d8645000-13a7-422e-be26-2823acd651c5 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:56.892609 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d8645000-13a7-422e-be26-2823acd651c5 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:56.996295 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-28233b2f-162e-49bd-a0ef-cebdab949063 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:56.997181 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-28233b2f-162e-49bd-a0ef-cebdab949063 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:57.012303 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-28233b2f-162e-49bd-a0ef-cebdab949063 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:57.013031 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-28233b2f-162e-49bd-a0ef-cebdab949063 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:57.013850 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-28233b2f-162e-49bd-a0ef-cebdab949063 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:57.014561 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-28233b2f-162e-49bd-a0ef-cebdab949063 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:57.065701 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-d8645000-13a7-422e-be26-2823acd651c5 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:57.086916 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-d8645000-13a7-422e-be26-2823acd651c5 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8" status: 200 len: 1472 microversion: 2.1 time: 0.219762 Apr 30 13:20:57.087970 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 340/600] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:56 2021] GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8 => generated 1472 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:57.420296 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [req-da380a7b-7c80-4ec4-9b18-e30861471d4c req-b41cfbc8-f15b-4bed-abef-3e4f9f4c7fb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93d74a82-eb0b-4b65-bbe2-8960312e9dd8", "name": "network-vif-deleted", "tag": "993e83a7-97b0-4089-ba75-29f8911a36c4"}]} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:20:57.421993 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:20:57.421993 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: warnings.warn(msg) Apr 30 13:20:57.441818 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-da380a7b-7c80-4ec4-9b18-e30861471d4c req-b41cfbc8-f15b-4bed-abef-3e4f9f4c7fb2 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:57.444258 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-da380a7b-7c80-4ec4-9b18-e30861471d4c req-b41cfbc8-f15b-4bed-abef-3e4f9f4c7fb2 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:57.497959 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.compute.server_external_events [req-da380a7b-7c80-4ec4-9b18-e30861471d4c req-b41cfbc8-f15b-4bed-abef-3e4f9f4c7fb2 service nova] Creating event network-vif-deleted:993e83a7-97b0-4089-ba75-29f8911a36c4 for instance 93d74a82-eb0b-4b65-bbe2-8960312e9dd8 on hv-cinder-78836 Apr 30 13:20:57.506946 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [req-da380a7b-7c80-4ec4-9b18-e30861471d4c req-b41cfbc8-f15b-4bed-abef-3e4f9f4c7fb2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089430 Apr 30 13:20:57.508294 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 341/601] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:20:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:20:57.516200 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-5bfc9581-4124-450f-b663-b47f9c593541 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:57.517013 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-5bfc9581-4124-450f-b663-b47f9c593541 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:57.526142 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5bfc9581-4124-450f-b663-b47f9c593541 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:57.526638 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5bfc9581-4124-450f-b663-b47f9c593541 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:57.527458 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5bfc9581-4124-450f-b663-b47f9c593541 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:57.527905 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5bfc9581-4124-450f-b663-b47f9c593541 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:57.692437 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-28233b2f-162e-49bd-a0ef-cebdab949063 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:57.706661 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-28233b2f-162e-49bd-a0ef-cebdab949063 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:57.708868 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-28233b2f-162e-49bd-a0ef-cebdab949063 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:57.710390 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-28233b2f-162e-49bd-a0ef-cebdab949063 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1793 microversion: 2.20 time: 0.717943 Apr 30 13:20:57.711393 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 261/602] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:20:56 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1793 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:20:57.716385 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-a265e0f2-d038-4ca8-aa38-3d0dc64cc1b5 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:57.717553 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-a265e0f2-d038-4ca8-aa38-3d0dc64cc1b5 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:57.743340 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a265e0f2-d038-4ca8-aa38-3d0dc64cc1b5 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:57.743845 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a265e0f2-d038-4ca8-aa38-3d0dc64cc1b5 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:57.744582 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a265e0f2-d038-4ca8-aa38-3d0dc64cc1b5 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:57.745796 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a265e0f2-d038-4ca8-aa38-3d0dc64cc1b5 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:57.853834 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-5bfc9581-4124-450f-b663-b47f9c593541 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:57.864441 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-5bfc9581-4124-450f-b663-b47f9c593541 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1520 microversion: 2.1 time: 0.353602 Apr 30 13:20:57.865746 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 342/603] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:57 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1520 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:57.898081 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-a265e0f2-d038-4ca8-aa38-3d0dc64cc1b5 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:57.909523 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-a265e0f2-d038-4ca8-aa38-3d0dc64cc1b5 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1277 microversion: 2.1 time: 0.196652 Apr 30 13:20:57.910365 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 262/604] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:57 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1277 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:58.104687 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-d156b2f4-1695-4d02-96f3-e4bcf628d9c6 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:58.105331 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-d156b2f4-1695-4d02-96f3-e4bcf628d9c6 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 93d74a82-eb0b-4b65-bbe2-8960312e9dd8] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:58.114834 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d156b2f4-1695-4d02-96f3-e4bcf628d9c6 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:58.115296 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d156b2f4-1695-4d02-96f3-e4bcf628d9c6 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:58.116756 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d156b2f4-1695-4d02-96f3-e4bcf628d9c6 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:58.116756 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d156b2f4-1695-4d02-96f3-e4bcf628d9c6 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:58.198896 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d156b2f4-1695-4d02-96f3-e4bcf628d9c6 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:58.199501 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d156b2f4-1695-4d02-96f3-e4bcf628d9c6 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:58.200063 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.objects.instance [None req-d156b2f4-1695-4d02-96f3-e4bcf628d9c6 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lazy-loading 'fault' on Instance uuid 93d74a82-eb0b-4b65-bbe2-8960312e9dd8 {{(pid=87933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:20:58.289762 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-d156b2f4-1695-4d02-96f3-e4bcf628d9c6 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:58.317648 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-d156b2f4-1695-4d02-96f3-e4bcf628d9c6 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8" status: 200 len: 1308 microversion: 2.1 time: 0.203046 Apr 30 13:20:58.317648 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 343/605] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:58 2021] GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8 => generated 1308 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:58.887302 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-0b863a6b-227e-41cd-b120-ce2ab8d8b10d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:58.888461 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-0b863a6b-227e-41cd-b120-ce2ab8d8b10d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:58.903486 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0b863a6b-227e-41cd-b120-ce2ab8d8b10d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:58.904294 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0b863a6b-227e-41cd-b120-ce2ab8d8b10d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:58.905734 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0b863a6b-227e-41cd-b120-ce2ab8d8b10d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:58.906563 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0b863a6b-227e-41cd-b120-ce2ab8d8b10d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:58.928596 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-5bc93435-acf2-4094-8330-e683c204423f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:58.929364 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-5bc93435-acf2-4094-8330-e683c204423f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:58.937263 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5bc93435-acf2-4094-8330-e683c204423f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:58.937914 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5bc93435-acf2-4094-8330-e683c204423f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:58.938738 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5bc93435-acf2-4094-8330-e683c204423f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:58.940008 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5bc93435-acf2-4094-8330-e683c204423f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:59.169272 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-5bc93435-acf2-4094-8330-e683c204423f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:59.179014 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-5bc93435-acf2-4094-8330-e683c204423f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1319 microversion: 2.1 time: 0.255786 Apr 30 13:20:59.179813 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 344/606] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:58 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1319 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:20:59.320742 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-6363b7e0-94fc-424b-a350-1ec4731cb347 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:59.321513 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-6363b7e0-94fc-424b-a350-1ec4731cb347 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 93d74a82-eb0b-4b65-bbe2-8960312e9dd8] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:59.329889 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6363b7e0-94fc-424b-a350-1ec4731cb347 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:59.330584 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6363b7e0-94fc-424b-a350-1ec4731cb347 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:59.331436 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6363b7e0-94fc-424b-a350-1ec4731cb347 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:59.331881 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6363b7e0-94fc-424b-a350-1ec4731cb347 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:59.387055 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.wsgi [None req-6363b7e0-94fc-424b-a350-1ec4731cb347 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] HTTP exception thrown: Instance 93d74a82-eb0b-4b65-bbe2-8960312e9dd8 could not be found. Apr 30 13:20:59.387708 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-6363b7e0-94fc-424b-a350-1ec4731cb347 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Returning 404 to user: Instance 93d74a82-eb0b-4b65-bbe2-8960312e9dd8 could not be found. {{(pid=87933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:20:59.388670 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-6363b7e0-94fc-424b-a350-1ec4731cb347 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8" status: 404 len: 111 microversion: 2.1 time: 0.071612 Apr 30 13:20:59.389238 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 345/607] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:59 2021] GET /compute/v2.1/servers/93d74a82-eb0b-4b65-bbe2-8960312e9dd8 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 13:20:59.398455 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-db836f7f-6c10-4e1e-b9fe-427bd2b48eb0 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:59.398958 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-db836f7f-6c10-4e1e-b9fe-427bd2b48eb0 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 725460b8-1eec-40a7-948f-6a7c80ebfd3b] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:59.408979 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-db836f7f-6c10-4e1e-b9fe-427bd2b48eb0 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:59.409637 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-db836f7f-6c10-4e1e-b9fe-427bd2b48eb0 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:59.411044 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-db836f7f-6c10-4e1e-b9fe-427bd2b48eb0 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:59.411377 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-db836f7f-6c10-4e1e-b9fe-427bd2b48eb0 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:59.415905 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-0b863a6b-227e-41cd-b120-ce2ab8d8b10d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:20:59.425414 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-0b863a6b-227e-41cd-b120-ce2ab8d8b10d tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1520 microversion: 2.1 time: 0.544980 Apr 30 13:20:59.427769 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 263/608] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:58 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1520 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:20:59.481469 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-db836f7f-6c10-4e1e-b9fe-427bd2b48eb0 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 725460b8-1eec-40a7-948f-6a7c80ebfd3b] Going to try to terminate instance {{(pid=87933) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 13:20:59.613794 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-db836f7f-6c10-4e1e-b9fe-427bd2b48eb0 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "DELETE /compute/v2.1/servers/725460b8-1eec-40a7-948f-6a7c80ebfd3b" status: 204 len: 0 microversion: 2.1 time: 0.218754 Apr 30 13:20:59.614499 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 346/609] 10.222.0.79 () {58 vars in 1239 bytes} [Fri Apr 30 13:20:59 2021] DELETE /compute/v2.1/servers/725460b8-1eec-40a7-948f-6a7c80ebfd3b => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 30 13:20:59.624605 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-b7a081fa-8fbe-4a28-8174-d2d663c653be tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:20:59.626361 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-b7a081fa-8fbe-4a28-8174-d2d663c653be tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 725460b8-1eec-40a7-948f-6a7c80ebfd3b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:20:59.637614 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b7a081fa-8fbe-4a28-8174-d2d663c653be tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:59.638284 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b7a081fa-8fbe-4a28-8174-d2d663c653be tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:20:59.639167 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b7a081fa-8fbe-4a28-8174-d2d663c653be tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:20:59.639624 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b7a081fa-8fbe-4a28-8174-d2d663c653be tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:00.040507 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-b7a081fa-8fbe-4a28-8174-d2d663c653be tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:00.050850 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-b7a081fa-8fbe-4a28-8174-d2d663c653be tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/725460b8-1eec-40a7-948f-6a7c80ebfd3b" status: 200 len: 1514 microversion: 2.1 time: 0.431161 Apr 30 13:21:00.051537 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 264/610] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:20:59 2021] GET /compute/v2.1/servers/725460b8-1eec-40a7-948f-6a7c80ebfd3b => generated 1514 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:00.121807 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [req-404ed49e-a872-477d-911c-20f8946fd053 req-7d536be9-772f-4c12-a717-162e29437363 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4c66a3a-0046-442b-a6c9-54494d8a7722", "tag": "3954223d-04e7-4b33-80b7-6667a5b1731c"}]} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:21:00.124039 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:21:00.124039 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: warnings.warn(msg) Apr 30 13:21:00.140517 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-404ed49e-a872-477d-911c-20f8946fd053 req-7d536be9-772f-4c12-a717-162e29437363 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:00.140970 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-404ed49e-a872-477d-911c-20f8946fd053 req-7d536be9-772f-4c12-a717-162e29437363 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:00.163730 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.compute.server_external_events [req-404ed49e-a872-477d-911c-20f8946fd053 req-7d536be9-772f-4c12-a717-162e29437363 service nova] Creating event network-changed:3954223d-04e7-4b33-80b7-6667a5b1731c for instance c4c66a3a-0046-442b-a6c9-54494d8a7722 on hv-cinder-78836 Apr 30 13:21:00.169035 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [req-404ed49e-a872-477d-911c-20f8946fd053 req-7d536be9-772f-4c12-a717-162e29437363 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052653 Apr 30 13:21:00.169638 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 347/611] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:21:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:21:00.196501 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-dc9efa7e-c440-4e38-9b90-e50f47b9680d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:00.197123 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-dc9efa7e-c440-4e38-9b90-e50f47b9680d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:00.205470 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-dc9efa7e-c440-4e38-9b90-e50f47b9680d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:00.206128 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-dc9efa7e-c440-4e38-9b90-e50f47b9680d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:00.206936 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-dc9efa7e-c440-4e38-9b90-e50f47b9680d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:00.207384 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-dc9efa7e-c440-4e38-9b90-e50f47b9680d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:00.445149 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-136cca9e-f0aa-48dc-bf04-0a24bde25ac9 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:00.446042 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-136cca9e-f0aa-48dc-bf04-0a24bde25ac9 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:00.454100 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-136cca9e-f0aa-48dc-bf04-0a24bde25ac9 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:00.454801 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-136cca9e-f0aa-48dc-bf04-0a24bde25ac9 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:00.456017 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-136cca9e-f0aa-48dc-bf04-0a24bde25ac9 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:00.456545 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-136cca9e-f0aa-48dc-bf04-0a24bde25ac9 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:00.608981 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-dc9efa7e-c440-4e38-9b90-e50f47b9680d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:00.620101 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-dc9efa7e-c440-4e38-9b90-e50f47b9680d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1319 microversion: 2.1 time: 0.427299 Apr 30 13:21:00.631722 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 265/612] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:00 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1319 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:00.678587 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-136cca9e-f0aa-48dc-bf04-0a24bde25ac9 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:00.687120 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-136cca9e-f0aa-48dc-bf04-0a24bde25ac9 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1520 microversion: 2.1 time: 0.246515 Apr 30 13:21:00.687691 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 348/613] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:00 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1520 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:21:01.072055 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-37238a83-3832-4423-beab-ee11d78e7fc0 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:01.073014 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-37238a83-3832-4423-beab-ee11d78e7fc0 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 725460b8-1eec-40a7-948f-6a7c80ebfd3b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:01.085739 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-37238a83-3832-4423-beab-ee11d78e7fc0 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:01.086862 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-37238a83-3832-4423-beab-ee11d78e7fc0 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:01.087932 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-37238a83-3832-4423-beab-ee11d78e7fc0 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:01.088700 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-37238a83-3832-4423-beab-ee11d78e7fc0 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:01.429048 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-37238a83-3832-4423-beab-ee11d78e7fc0 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:01.437896 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-37238a83-3832-4423-beab-ee11d78e7fc0 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/725460b8-1eec-40a7-948f-6a7c80ebfd3b" status: 200 len: 1514 microversion: 2.1 time: 0.372391 Apr 30 13:21:01.438520 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 266/614] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:01 2021] GET /compute/v2.1/servers/725460b8-1eec-40a7-948f-6a7c80ebfd3b => generated 1514 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:01.637240 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-5ee694f2-fd0c-422c-9f38-3ad6aacfdd1e tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:01.637860 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-5ee694f2-fd0c-422c-9f38-3ad6aacfdd1e tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:01.646806 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5ee694f2-fd0c-422c-9f38-3ad6aacfdd1e tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:01.647271 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5ee694f2-fd0c-422c-9f38-3ad6aacfdd1e tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:01.648078 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5ee694f2-fd0c-422c-9f38-3ad6aacfdd1e tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:01.648769 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5ee694f2-fd0c-422c-9f38-3ad6aacfdd1e tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:01.710190 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-a59f47ff-2226-4ca7-87e8-68d152c38ed4 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:01.711853 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-a59f47ff-2226-4ca7-87e8-68d152c38ed4 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:01.725746 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a59f47ff-2226-4ca7-87e8-68d152c38ed4 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:01.726623 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a59f47ff-2226-4ca7-87e8-68d152c38ed4 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:01.727880 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a59f47ff-2226-4ca7-87e8-68d152c38ed4 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:01.728574 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a59f47ff-2226-4ca7-87e8-68d152c38ed4 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:01.943642 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-5ee694f2-fd0c-422c-9f38-3ad6aacfdd1e tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:01.952536 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-5ee694f2-fd0c-422c-9f38-3ad6aacfdd1e tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1319 microversion: 2.1 time: 0.318966 Apr 30 13:21:01.953356 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 349/615] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:01 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1319 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:02.170627 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-a59f47ff-2226-4ca7-87e8-68d152c38ed4 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:02.179744 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-a59f47ff-2226-4ca7-87e8-68d152c38ed4 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1520 microversion: 2.1 time: 0.478555 Apr 30 13:21:02.180337 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 267/616] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:01 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1520 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:02.455985 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-50713b22-973e-4123-ad6b-bf12c769fd65 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:02.456600 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-50713b22-973e-4123-ad6b-bf12c769fd65 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 725460b8-1eec-40a7-948f-6a7c80ebfd3b] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:02.464312 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-50713b22-973e-4123-ad6b-bf12c769fd65 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:02.464745 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-50713b22-973e-4123-ad6b-bf12c769fd65 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:02.465555 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-50713b22-973e-4123-ad6b-bf12c769fd65 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:02.466374 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-50713b22-973e-4123-ad6b-bf12c769fd65 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:02.750793 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-50713b22-973e-4123-ad6b-bf12c769fd65 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:02.762832 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-50713b22-973e-4123-ad6b-bf12c769fd65 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/725460b8-1eec-40a7-948f-6a7c80ebfd3b" status: 200 len: 1514 microversion: 2.1 time: 0.311396 Apr 30 13:21:02.764247 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 350/617] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:02 2021] GET /compute/v2.1/servers/725460b8-1eec-40a7-948f-6a7c80ebfd3b => generated 1514 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:21:02.972033 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-68933fb0-e9d5-491d-a7b7-e63ff88a11b9 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:02.973030 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-68933fb0-e9d5-491d-a7b7-e63ff88a11b9 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:02.981602 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-68933fb0-e9d5-491d-a7b7-e63ff88a11b9 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:02.982542 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-68933fb0-e9d5-491d-a7b7-e63ff88a11b9 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:02.983464 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-68933fb0-e9d5-491d-a7b7-e63ff88a11b9 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:02.984217 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-68933fb0-e9d5-491d-a7b7-e63ff88a11b9 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:03.069979 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [req-d8e00154-ae73-4d2e-b42a-e9ae4ad1a875 req-6b7d2a0a-ec03-428d-923a-9958b1a87a83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "725460b8-1eec-40a7-948f-6a7c80ebfd3b", "name": "network-vif-deleted", "tag": "86cb4292-c6ff-4438-9d30-9f8d53f9b4bf"}]} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:21:03.073341 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:21:03.073341 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: warnings.warn(msg) Apr 30 13:21:03.093223 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-d8e00154-ae73-4d2e-b42a-e9ae4ad1a875 req-6b7d2a0a-ec03-428d-923a-9958b1a87a83 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:03.096873 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-d8e00154-ae73-4d2e-b42a-e9ae4ad1a875 req-6b7d2a0a-ec03-428d-923a-9958b1a87a83 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:03.135050 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.compute.server_external_events [req-d8e00154-ae73-4d2e-b42a-e9ae4ad1a875 req-6b7d2a0a-ec03-428d-923a-9958b1a87a83 service nova] Creating event network-vif-deleted:86cb4292-c6ff-4438-9d30-9f8d53f9b4bf for instance 725460b8-1eec-40a7-948f-6a7c80ebfd3b on hv-cinder-78836 Apr 30 13:21:03.143524 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [req-d8e00154-ae73-4d2e-b42a-e9ae4ad1a875 req-6b7d2a0a-ec03-428d-923a-9958b1a87a83 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081797 Apr 30 13:21:03.144645 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 351/618] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:21:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:21:03.198812 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-203564f1-38dd-4079-a75b-7b1537bb8de6 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:03.200563 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-203564f1-38dd-4079-a75b-7b1537bb8de6 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:03.214713 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-203564f1-38dd-4079-a75b-7b1537bb8de6 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:03.215623 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-203564f1-38dd-4079-a75b-7b1537bb8de6 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:03.217799 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-203564f1-38dd-4079-a75b-7b1537bb8de6 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:03.218866 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-203564f1-38dd-4079-a75b-7b1537bb8de6 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:03.461319 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-68933fb0-e9d5-491d-a7b7-e63ff88a11b9 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:03.482746 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-68933fb0-e9d5-491d-a7b7-e63ff88a11b9 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1319 microversion: 2.1 time: 0.514732 Apr 30 13:21:03.484537 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-203564f1-38dd-4079-a75b-7b1537bb8de6 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:03.498271 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-203564f1-38dd-4079-a75b-7b1537bb8de6 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1520 microversion: 2.1 time: 0.303253 Apr 30 13:21:03.498872 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 268/619] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:02 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1319 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:03.499860 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 352/620] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:03 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1520 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:21:03.781889 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-638a2979-98cf-4123-be35-1a1fbfc33d11 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:03.783570 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-638a2979-98cf-4123-be35-1a1fbfc33d11 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 725460b8-1eec-40a7-948f-6a7c80ebfd3b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:03.794640 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-638a2979-98cf-4123-be35-1a1fbfc33d11 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:03.796040 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-638a2979-98cf-4123-be35-1a1fbfc33d11 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:03.798942 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-638a2979-98cf-4123-be35-1a1fbfc33d11 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:03.799837 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-638a2979-98cf-4123-be35-1a1fbfc33d11 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:03.891624 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-638a2979-98cf-4123-be35-1a1fbfc33d11 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:03.893293 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-638a2979-98cf-4123-be35-1a1fbfc33d11 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:03.894737 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.objects.instance [None req-638a2979-98cf-4123-be35-1a1fbfc33d11 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lazy-loading 'fault' on Instance uuid 725460b8-1eec-40a7-948f-6a7c80ebfd3b {{(pid=87932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:21:04.046528 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-638a2979-98cf-4123-be35-1a1fbfc33d11 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:04.055757 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-638a2979-98cf-4123-be35-1a1fbfc33d11 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/725460b8-1eec-40a7-948f-6a7c80ebfd3b" status: 200 len: 1307 microversion: 2.1 time: 0.278162 Apr 30 13:21:04.056550 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 269/621] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:03 2021] GET /compute/v2.1/servers/725460b8-1eec-40a7-948f-6a7c80ebfd3b => generated 1307 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:04.510833 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-5bfde2f2-3b93-42c6-ac9f-91c497ebef6b tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:04.511642 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-5bfde2f2-3b93-42c6-ac9f-91c497ebef6b tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:04.519494 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5bfde2f2-3b93-42c6-ac9f-91c497ebef6b tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:04.519869 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-fc5a89e7-db75-44a3-941f-f6d0ef226b4e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:04.520321 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5bfde2f2-3b93-42c6-ac9f-91c497ebef6b tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:04.520889 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5bfde2f2-3b93-42c6-ac9f-91c497ebef6b tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:04.521336 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5bfde2f2-3b93-42c6-ac9f-91c497ebef6b tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:04.521657 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-fc5a89e7-db75-44a3-941f-f6d0ef226b4e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:04.535423 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fc5a89e7-db75-44a3-941f-f6d0ef226b4e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:04.536672 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fc5a89e7-db75-44a3-941f-f6d0ef226b4e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:04.538266 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fc5a89e7-db75-44a3-941f-f6d0ef226b4e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:04.539175 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fc5a89e7-db75-44a3-941f-f6d0ef226b4e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:04.673554 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fc5a89e7-db75-44a3-941f-f6d0ef226b4e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:04.674212 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fc5a89e7-db75-44a3-941f-f6d0ef226b4e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:04.674688 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.objects.instance [None req-fc5a89e7-db75-44a3-941f-f6d0ef226b4e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lazy-loading 'fault' on Instance uuid aa7277ee-287a-481c-a0e8-ae4dc4053a0e {{(pid=87932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:21:04.736070 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-5bfde2f2-3b93-42c6-ac9f-91c497ebef6b tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:04.746123 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-5bfde2f2-3b93-42c6-ac9f-91c497ebef6b tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1319 microversion: 2.1 time: 0.240336 Apr 30 13:21:04.746780 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 353/622] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:04 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:04.757166 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-fc5a89e7-db75-44a3-941f-f6d0ef226b4e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '724ff4b164904585a857922d30c6752c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c622a56261f04601a7a4b9b607f9eddd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:04.766146 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-fc5a89e7-db75-44a3-941f-f6d0ef226b4e tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 200 len: 1311 microversion: 2.1 time: 0.253368 Apr 30 13:21:04.767107 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 270/623] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:04 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 1311 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:05.073289 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-4cdc8e00-7cb9-4bae-8671-24cb42281082 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:05.073920 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-4cdc8e00-7cb9-4bae-8671-24cb42281082 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: 725460b8-1eec-40a7-948f-6a7c80ebfd3b] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:05.082035 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4cdc8e00-7cb9-4bae-8671-24cb42281082 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:05.082519 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4cdc8e00-7cb9-4bae-8671-24cb42281082 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:05.083355 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4cdc8e00-7cb9-4bae-8671-24cb42281082 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:05.083802 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4cdc8e00-7cb9-4bae-8671-24cb42281082 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:05.138348 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.wsgi [None req-4cdc8e00-7cb9-4bae-8671-24cb42281082 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] HTTP exception thrown: Instance 725460b8-1eec-40a7-948f-6a7c80ebfd3b could not be found. Apr 30 13:21:05.138966 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-4cdc8e00-7cb9-4bae-8671-24cb42281082 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Returning 404 to user: Instance 725460b8-1eec-40a7-948f-6a7c80ebfd3b could not be found. {{(pid=87933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:21:05.140120 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-4cdc8e00-7cb9-4bae-8671-24cb42281082 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/725460b8-1eec-40a7-948f-6a7c80ebfd3b" status: 404 len: 111 microversion: 2.1 time: 0.071072 Apr 30 13:21:05.140680 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 354/624] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:05 2021] GET /compute/v2.1/servers/725460b8-1eec-40a7-948f-6a7c80ebfd3b => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:21:05.160678 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [req-95e429c0-5b86-475c-a509-db9aaba57f98 req-7856f551-468b-48ec-b7fe-b410acc7a29c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa7277ee-287a-481c-a0e8-ae4dc4053a0e", "name": "network-vif-deleted", "tag": "3291dc06-c1f9-4322-b292-ef88b1d2e531"}]} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:21:05.162619 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:21:05.162619 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: warnings.warn(msg) Apr 30 13:21:05.171343 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-95e429c0-5b86-475c-a509-db9aaba57f98 req-7856f551-468b-48ec-b7fe-b410acc7a29c service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:05.171787 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-95e429c0-5b86-475c-a509-db9aaba57f98 req-7856f551-468b-48ec-b7fe-b410acc7a29c service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:05.188731 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.compute.server_external_events [req-95e429c0-5b86-475c-a509-db9aaba57f98 req-7856f551-468b-48ec-b7fe-b410acc7a29c service nova] Creating event network-vif-deleted:3291dc06-c1f9-4322-b292-ef88b1d2e531 for instance aa7277ee-287a-481c-a0e8-ae4dc4053a0e on hv-cinder-78836 Apr 30 13:21:05.193586 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [req-95e429c0-5b86-475c-a509-db9aaba57f98 req-7856f551-468b-48ec-b7fe-b410acc7a29c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037091 Apr 30 13:21:05.194223 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 271/625] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:21:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:21:05.764507 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-e31e3a79-28a2-4baa-9196-c520f1ea1fc7 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:05.765395 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-e31e3a79-28a2-4baa-9196-c520f1ea1fc7 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:05.775360 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e31e3a79-28a2-4baa-9196-c520f1ea1fc7 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:05.776151 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e31e3a79-28a2-4baa-9196-c520f1ea1fc7 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:05.778932 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e31e3a79-28a2-4baa-9196-c520f1ea1fc7 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:05.778932 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e31e3a79-28a2-4baa-9196-c520f1ea1fc7 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:05.785578 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-fa2001f7-ef17-4486-8482-703785986ae9 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:05.786893 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-fa2001f7-ef17-4486-8482-703785986ae9 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] [instance: aa7277ee-287a-481c-a0e8-ae4dc4053a0e] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:05.794930 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fa2001f7-ef17-4486-8482-703785986ae9 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:05.795714 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fa2001f7-ef17-4486-8482-703785986ae9 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:05.796979 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fa2001f7-ef17-4486-8482-703785986ae9 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:05.797588 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fa2001f7-ef17-4486-8482-703785986ae9 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:05.857155 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.wsgi [None req-fa2001f7-ef17-4486-8482-703785986ae9 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] HTTP exception thrown: Instance aa7277ee-287a-481c-a0e8-ae4dc4053a0e could not be found. Apr 30 13:21:05.858705 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-fa2001f7-ef17-4486-8482-703785986ae9 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] Returning 404 to user: Instance aa7277ee-287a-481c-a0e8-ae4dc4053a0e could not be found. {{(pid=87932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:21:05.860223 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-fa2001f7-ef17-4486-8482-703785986ae9 tempest-ServerRescueNegativeTestJSON-739862613 tempest-ServerRescueNegativeTestJSON-739862613-project] 10.222.0.79 "GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e" status: 404 len: 111 microversion: 2.1 time: 0.079313 Apr 30 13:21:05.861820 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 272/626] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:05 2021] GET /compute/v2.1/servers/aa7277ee-287a-481c-a0e8-ae4dc4053a0e => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:21:05.921682 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [req-87bad498-1bd4-40e2-8ffa-3efdf2a230c6 req-c53f968e-4f1f-49e8-b8d6-b0caeaacf180 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4c66a3a-0046-442b-a6c9-54494d8a7722", "name": "network-vif-plugged", "status": "completed", "tag": "3954223d-04e7-4b33-80b7-6667a5b1731c"}]} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:21:05.923567 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:21:05.923567 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: warnings.warn(msg) Apr 30 13:21:05.932492 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-87bad498-1bd4-40e2-8ffa-3efdf2a230c6 req-c53f968e-4f1f-49e8-b8d6-b0caeaacf180 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:05.933223 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-87bad498-1bd4-40e2-8ffa-3efdf2a230c6 req-c53f968e-4f1f-49e8-b8d6-b0caeaacf180 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:05.951384 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.compute.server_external_events [req-87bad498-1bd4-40e2-8ffa-3efdf2a230c6 req-c53f968e-4f1f-49e8-b8d6-b0caeaacf180 service nova] Creating event network-vif-plugged:3954223d-04e7-4b33-80b7-6667a5b1731c for instance c4c66a3a-0046-442b-a6c9-54494d8a7722 on hv-cinder-78836 Apr 30 13:21:05.958630 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [req-87bad498-1bd4-40e2-8ffa-3efdf2a230c6 req-c53f968e-4f1f-49e8-b8d6-b0caeaacf180 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040843 Apr 30 13:21:05.959562 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 273/627] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:21:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:21:06.021833 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-e31e3a79-28a2-4baa-9196-c520f1ea1fc7 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:06.033471 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-e31e3a79-28a2-4baa-9196-c520f1ea1fc7 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1319 microversion: 2.1 time: 0.271816 Apr 30 13:21:06.038798 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 355/628] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:05 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1319 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:06.385313 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-fb004115-153f-4b26-ab80-3fd1c45de256 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:06.385887 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-fb004115-153f-4b26-ab80-3fd1c45de256 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: d94a56dc-cb9d-4b55-9f89-b121d45230ca] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:06.394260 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fb004115-153f-4b26-ab80-3fd1c45de256 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:06.394716 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fb004115-153f-4b26-ab80-3fd1c45de256 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:06.395520 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fb004115-153f-4b26-ab80-3fd1c45de256 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:06.395968 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fb004115-153f-4b26-ab80-3fd1c45de256 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:06.462509 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-fb004115-153f-4b26-ab80-3fd1c45de256 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: d94a56dc-cb9d-4b55-9f89-b121d45230ca] Going to try to terminate instance {{(pid=87932) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 13:21:06.589361 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-fb004115-153f-4b26-ab80-3fd1c45de256 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca" status: 204 len: 0 microversion: 2.1 time: 0.207843 Apr 30 13:21:06.590122 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 274/629] 10.222.0.79 () {58 vars in 1239 bytes} [Fri Apr 30 13:21:06 2021] DELETE /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 13:21:06.599239 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-14e28e90-555b-4bac-abec-eb07d335ada4 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:06.600055 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-14e28e90-555b-4bac-abec-eb07d335ada4 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: d94a56dc-cb9d-4b55-9f89-b121d45230ca] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:06.608076 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-14e28e90-555b-4bac-abec-eb07d335ada4 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:06.608643 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-14e28e90-555b-4bac-abec-eb07d335ada4 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:06.609616 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-14e28e90-555b-4bac-abec-eb07d335ada4 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:06.610200 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-14e28e90-555b-4bac-abec-eb07d335ada4 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:06.862114 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-14e28e90-555b-4bac-abec-eb07d335ada4 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:06.874119 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-14e28e90-555b-4bac-abec-eb07d335ada4 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca" status: 200 len: 1515 microversion: 2.1 time: 0.279185 Apr 30 13:21:06.874880 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 356/630] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:06 2021] GET /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca => generated 1515 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:07.055573 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-61f78ee8-7fb9-4cf9-964b-5843d04c1bd0 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:07.056197 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-61f78ee8-7fb9-4cf9-964b-5843d04c1bd0 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:07.064105 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-61f78ee8-7fb9-4cf9-964b-5843d04c1bd0 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:07.064770 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-61f78ee8-7fb9-4cf9-964b-5843d04c1bd0 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:07.065584 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-61f78ee8-7fb9-4cf9-964b-5843d04c1bd0 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:07.066050 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-61f78ee8-7fb9-4cf9-964b-5843d04c1bd0 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:07.486424 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-5f5d5fa1-f58c-4fa4-99da-3038ef4d6ece tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2070851934", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2009375504", "security_groups": [{"name": "tempest-secgroup-smoke-231922475"}], "networks": [{"uuid": "0613c2aa-52f3-4a8e-ab47-3971bf09acb3"}], "block_device_mapping_v2": [{"uuid": "a5ee7845-1276-46be-9ce5-b145a69b9742", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:21:07.512784 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-61f78ee8-7fb9-4cf9-964b-5843d04c1bd0 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:07.522732 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-61f78ee8-7fb9-4cf9-964b-5843d04c1bd0 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1319 microversion: 2.1 time: 0.471404 Apr 30 13:21:07.528377 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 275/631] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:07 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1319 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:07.691309 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.network.neutron [None req-5f5d5fa1-f58c-4fa4-99da-3038ef4d6ece tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] validate_networks() for [('0613c2aa-52f3-4a8e-ab47-3971bf09acb3', None, None, None)] {{(pid=87933) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 13:21:07.893779 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-a8606cb2-f962-46d5-b9e3-4674c65f359a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:07.894690 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-a8606cb2-f962-46d5-b9e3-4674c65f359a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: d94a56dc-cb9d-4b55-9f89-b121d45230ca] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:07.904840 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a8606cb2-f962-46d5-b9e3-4674c65f359a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:07.905371 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a8606cb2-f962-46d5-b9e3-4674c65f359a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:07.906407 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a8606cb2-f962-46d5-b9e3-4674c65f359a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:07.907017 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a8606cb2-f962-46d5-b9e3-4674c65f359a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:08.324679 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.virt.hardware [None req-5f5d5fa1-f58c-4fa4-99da-3038ef4d6ece tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Flavor limits 0:0:0 {{(pid=87933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 13:21:08.325298 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.virt.hardware [None req-5f5d5fa1-f58c-4fa4-99da-3038ef4d6ece tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Image limits 0:0:0 {{(pid=87933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 13:21:08.325816 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.virt.hardware [None req-5f5d5fa1-f58c-4fa4-99da-3038ef4d6ece tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Flavor pref 0:0:0 {{(pid=87933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 13:21:08.326489 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.virt.hardware [None req-5f5d5fa1-f58c-4fa4-99da-3038ef4d6ece tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Image pref 0:0:0 {{(pid=87933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 13:21:08.327167 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.virt.hardware [None req-5f5d5fa1-f58c-4fa4-99da-3038ef4d6ece tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 13:21:08.337317 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5f5d5fa1-f58c-4fa4-99da-3038ef4d6ece tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:08.338357 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5f5d5fa1-f58c-4fa4-99da-3038ef4d6ece tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:08.338871 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5f5d5fa1-f58c-4fa4-99da-3038ef4d6ece tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:08.339323 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5f5d5fa1-f58c-4fa4-99da-3038ef4d6ece tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:08.357878 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.quota [None req-5f5d5fa1-f58c-4fa4-99da-3038ef4d6ece tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Getting quotas for project 4d9dbe0005674e0899b90b9db4c9423e. Resources: {'ram', 'instances', 'cores'} {{(pid=87933) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:21:08.363056 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.quota [None req-5f5d5fa1-f58c-4fa4-99da-3038ef4d6ece tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Getting quotas for user a10ef3b5434242cc8c5b15a1bb36f735 and project 4d9dbe0005674e0899b90b9db4c9423e. Resources: {'ram', 'instances', 'cores'} {{(pid=87933) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:21:08.460926 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-a8606cb2-f962-46d5-b9e3-4674c65f359a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:08.469298 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-5f5d5fa1-f58c-4fa4-99da-3038ef4d6ece tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Going to run 1 instances... {{(pid=87933) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 13:21:08.471380 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-a8606cb2-f962-46d5-b9e3-4674c65f359a tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca" status: 200 len: 1515 microversion: 2.1 time: 0.582225 Apr 30 13:21:08.471584 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-5f5d5fa1-f58c-4fa4-99da-3038ef4d6ece tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a5ee7845-1276-46be-9ce5-b145a69b9742',volume_size=None,volume_type=None)] {{(pid=87933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 13:21:08.472217 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 276/632] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:07 2021] GET /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca => generated 1515 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:08.541770 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-14a83dd3-8d2b-48ec-90ef-37ed84be8e41 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:08.542872 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-14a83dd3-8d2b-48ec-90ef-37ed84be8e41 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:08.554709 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-14a83dd3-8d2b-48ec-90ef-37ed84be8e41 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:08.555211 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-14a83dd3-8d2b-48ec-90ef-37ed84be8e41 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:08.556061 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-14a83dd3-8d2b-48ec-90ef-37ed84be8e41 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:08.556512 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-14a83dd3-8d2b-48ec-90ef-37ed84be8e41 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:08.663406 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-5f5d5fa1-f58c-4fa4-99da-3038ef4d6ece tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.181063 Apr 30 13:21:08.664173 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 357/633] 10.222.0.79 () {60 vars in 1147 bytes} [Fri Apr 30 13:21:07 2021] POST /compute/v2.1/servers => generated 405 bytes in 1183 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 13:21:08.675059 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-6820e159-ab73-4286-964b-138f53352ae8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:08.675973 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-6820e159-ab73-4286-964b-138f53352ae8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:08.759983 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-6820e159-ab73-4286-964b-138f53352ae8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:08.780564 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-6820e159-ab73-4286-964b-138f53352ae8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1089 microversion: 2.1 time: 0.108912 Apr 30 13:21:08.781991 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 358/634] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:08 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1089 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:21:08.918947 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-14a83dd3-8d2b-48ec-90ef-37ed84be8e41 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:08.935143 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-14a83dd3-8d2b-48ec-90ef-37ed84be8e41 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1509 microversion: 2.1 time: 0.397540 Apr 30 13:21:08.935968 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 277/635] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:08 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1509 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:21:08.952463 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b0f2714b-c78f-4c27-b8a4-9c2e2df50d74 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2abcea42-b805-487e-a58b-200e59b6a4d0", "device": "/dev/sdb"}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:21:08.955087 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-b0f2714b-c78f-4c27-b8a4-9c2e2df50d74 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:08.964547 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b0f2714b-c78f-4c27-b8a4-9c2e2df50d74 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:08.965006 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b0f2714b-c78f-4c27-b8a4-9c2e2df50d74 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:08.966042 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b0f2714b-c78f-4c27-b8a4-9c2e2df50d74 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:08.966660 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b0f2714b-c78f-4c27-b8a4-9c2e2df50d74 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:09.489591 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-56b661fc-9863-4ba0-81ca-46a70cdc798c tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:09.490565 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-56b661fc-9863-4ba0-81ca-46a70cdc798c tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: d94a56dc-cb9d-4b55-9f89-b121d45230ca] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:09.504683 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-56b661fc-9863-4ba0-81ca-46a70cdc798c tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:09.505311 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-56b661fc-9863-4ba0-81ca-46a70cdc798c tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:09.506276 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-56b661fc-9863-4ba0-81ca-46a70cdc798c tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:09.511788 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-56b661fc-9863-4ba0-81ca-46a70cdc798c tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:09.518201 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b0f2714b-c78f-4c27-b8a4-9c2e2df50d74 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "POST /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.569252 Apr 30 13:21:09.530206 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 359/636] 10.222.0.79 () {60 vars in 1323 bytes} [Fri Apr 30 13:21:08 2021] POST /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722/os-volume_attachments => generated 194 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:21:09.801443 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-1108aa64-fa04-4503-aa12-dcda9f6052d2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:09.802360 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-1108aa64-fa04-4503-aa12-dcda9f6052d2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:09.811461 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1108aa64-fa04-4503-aa12-dcda9f6052d2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:09.812010 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1108aa64-fa04-4503-aa12-dcda9f6052d2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:09.812987 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1108aa64-fa04-4503-aa12-dcda9f6052d2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:09.813651 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1108aa64-fa04-4503-aa12-dcda9f6052d2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:10.025274 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-1108aa64-fa04-4503-aa12-dcda9f6052d2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:10.051619 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-1108aa64-fa04-4503-aa12-dcda9f6052d2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1187 microversion: 2.1 time: 0.255056 Apr 30 13:21:10.069321 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 360/637] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:09 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1187 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:21:10.258546 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-56b661fc-9863-4ba0-81ca-46a70cdc798c tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:10.268819 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-56b661fc-9863-4ba0-81ca-46a70cdc798c tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca" status: 200 len: 1515 microversion: 2.1 time: 0.783678 Apr 30 13:21:10.269631 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 278/638] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:09 2021] GET /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca => generated 1515 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:21:11.076798 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-144412f4-c984-4bb4-b92f-e088b0b41575 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:11.077426 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-144412f4-c984-4bb4-b92f-e088b0b41575 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:11.086337 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-144412f4-c984-4bb4-b92f-e088b0b41575 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:11.086806 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-144412f4-c984-4bb4-b92f-e088b0b41575 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:11.087609 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-144412f4-c984-4bb4-b92f-e088b0b41575 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:11.089000 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-144412f4-c984-4bb4-b92f-e088b0b41575 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:11.207151 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-144412f4-c984-4bb4-b92f-e088b0b41575 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:11.216397 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-144412f4-c984-4bb4-b92f-e088b0b41575 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1205 microversion: 2.1 time: 0.143376 Apr 30 13:21:11.217345 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 361/639] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:11 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1205 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:11.287703 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-d0a4ad49-cf99-456d-99fc-dd8a3b0736b7 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:11.288500 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-d0a4ad49-cf99-456d-99fc-dd8a3b0736b7 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: d94a56dc-cb9d-4b55-9f89-b121d45230ca] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:11.296254 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d0a4ad49-cf99-456d-99fc-dd8a3b0736b7 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:11.296818 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d0a4ad49-cf99-456d-99fc-dd8a3b0736b7 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:11.297690 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d0a4ad49-cf99-456d-99fc-dd8a3b0736b7 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:11.298243 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d0a4ad49-cf99-456d-99fc-dd8a3b0736b7 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:11.387880 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [req-78acef8a-5978-4fc0-ab47-118f36810e80 req-89a4b991-a6b6-439e-ac4d-90cbf381d678 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d94a56dc-cb9d-4b55-9f89-b121d45230ca", "name": "network-vif-deleted", "tag": "50ec7608-d829-47e1-b2f7-14e702acb0fc"}]} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:21:11.389434 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:21:11.389434 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: warnings.warn(msg) Apr 30 13:21:11.399183 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-78acef8a-5978-4fc0-ab47-118f36810e80 req-89a4b991-a6b6-439e-ac4d-90cbf381d678 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:11.399659 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-78acef8a-5978-4fc0-ab47-118f36810e80 req-89a4b991-a6b6-439e-ac4d-90cbf381d678 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:11.418129 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.compute.server_external_events [req-78acef8a-5978-4fc0-ab47-118f36810e80 req-89a4b991-a6b6-439e-ac4d-90cbf381d678 service nova] Creating event network-vif-deleted:50ec7608-d829-47e1-b2f7-14e702acb0fc for instance d94a56dc-cb9d-4b55-9f89-b121d45230ca on hv-cinder-78836 Apr 30 13:21:11.423055 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [req-78acef8a-5978-4fc0-ab47-118f36810e80 req-89a4b991-a6b6-439e-ac4d-90cbf381d678 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039062 Apr 30 13:21:11.423714 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 362/640] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:21:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:21:11.543548 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-d0a4ad49-cf99-456d-99fc-dd8a3b0736b7 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2a53be36b2d4d6681dacffb5843510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8dcaa02d735401891147a4c2464e318', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:11.553590 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-d0a4ad49-cf99-456d-99fc-dd8a3b0736b7 tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca" status: 200 len: 1473 microversion: 2.1 time: 0.269956 Apr 30 13:21:11.563275 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 279/641] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:11 2021] GET /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca => generated 1473 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:12.236248 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-62d4becd-1948-4116-99db-24aa8ced5449 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:12.237004 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-62d4becd-1948-4116-99db-24aa8ced5449 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:12.249297 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-62d4becd-1948-4116-99db-24aa8ced5449 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:12.249748 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-62d4becd-1948-4116-99db-24aa8ced5449 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:12.250581 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-62d4becd-1948-4116-99db-24aa8ced5449 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:12.251426 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-62d4becd-1948-4116-99db-24aa8ced5449 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:12.432778 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-62d4becd-1948-4116-99db-24aa8ced5449 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:12.443134 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-62d4becd-1948-4116-99db-24aa8ced5449 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1205 microversion: 2.1 time: 0.211907 Apr 30 13:21:12.443957 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 363/642] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:12 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1205 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:12.574172 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-ecba9b70-9e35-478f-a3b5-4d6349f5233f tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:12.574938 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-ecba9b70-9e35-478f-a3b5-4d6349f5233f tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] [instance: d94a56dc-cb9d-4b55-9f89-b121d45230ca] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:12.583280 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ecba9b70-9e35-478f-a3b5-4d6349f5233f tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:12.584087 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ecba9b70-9e35-478f-a3b5-4d6349f5233f tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:12.585865 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ecba9b70-9e35-478f-a3b5-4d6349f5233f tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:12.586784 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ecba9b70-9e35-478f-a3b5-4d6349f5233f tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:12.649967 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.wsgi [None req-ecba9b70-9e35-478f-a3b5-4d6349f5233f tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] HTTP exception thrown: Instance d94a56dc-cb9d-4b55-9f89-b121d45230ca could not be found. Apr 30 13:21:12.650962 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-ecba9b70-9e35-478f-a3b5-4d6349f5233f tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] Returning 404 to user: Instance d94a56dc-cb9d-4b55-9f89-b121d45230ca could not be found. {{(pid=87932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:21:12.652161 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-ecba9b70-9e35-478f-a3b5-4d6349f5233f tempest-AttachVolumeNegativeTest-698859741 tempest-AttachVolumeNegativeTest-698859741-project] 10.222.0.79 "GET /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca" status: 404 len: 111 microversion: 2.1 time: 0.082897 Apr 30 13:21:12.656447 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 280/643] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:12 2021] GET /compute/v2.1/servers/d94a56dc-cb9d-4b55-9f89-b121d45230ca => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:21:13.462281 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-d78e1a43-9dbb-437f-88e7-dc0a1bfd8a9d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:13.463665 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-d78e1a43-9dbb-437f-88e7-dc0a1bfd8a9d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:13.474198 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d78e1a43-9dbb-437f-88e7-dc0a1bfd8a9d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:13.475182 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d78e1a43-9dbb-437f-88e7-dc0a1bfd8a9d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:13.476718 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d78e1a43-9dbb-437f-88e7-dc0a1bfd8a9d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:13.477289 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d78e1a43-9dbb-437f-88e7-dc0a1bfd8a9d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:13.978534 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-d78e1a43-9dbb-437f-88e7-dc0a1bfd8a9d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:13.988539 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-d78e1a43-9dbb-437f-88e7-dc0a1bfd8a9d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1272 microversion: 2.1 time: 0.531109 Apr 30 13:21:13.989260 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 364/644] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:13 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1272 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:14.273902 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [req-463d1775-ee0a-4944-9560-35fca082cee1 req-8767b082-0055-40f0-81f9-2964775b34e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d5ad250-b1c3-4849-9018-b9814f65927c", "tag": "1ca6d999-b984-4833-8b8f-a6e9c0526e9e"}]} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:21:14.277164 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:21:14.277164 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: warnings.warn(msg) Apr 30 13:21:14.289424 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-463d1775-ee0a-4944-9560-35fca082cee1 req-8767b082-0055-40f0-81f9-2964775b34e1 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:14.290302 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-463d1775-ee0a-4944-9560-35fca082cee1 req-8767b082-0055-40f0-81f9-2964775b34e1 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:14.314441 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.compute.server_external_events [req-463d1775-ee0a-4944-9560-35fca082cee1 req-8767b082-0055-40f0-81f9-2964775b34e1 service nova] Creating event network-changed:1ca6d999-b984-4833-8b8f-a6e9c0526e9e for instance 9d5ad250-b1c3-4849-9018-b9814f65927c on hv-cinder-78836 Apr 30 13:21:14.320565 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [req-463d1775-ee0a-4944-9560-35fca082cee1 req-8767b082-0055-40f0-81f9-2964775b34e1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050775 Apr 30 13:21:14.321857 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 281/645] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:21:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:21:15.011691 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-1a4d1c97-99f3-4ce2-b5ff-d8eac829ade1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:15.013060 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-1a4d1c97-99f3-4ce2-b5ff-d8eac829ade1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:15.022647 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1a4d1c97-99f3-4ce2-b5ff-d8eac829ade1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:15.026037 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1a4d1c97-99f3-4ce2-b5ff-d8eac829ade1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:15.026037 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1a4d1c97-99f3-4ce2-b5ff-d8eac829ade1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:15.026037 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1a4d1c97-99f3-4ce2-b5ff-d8eac829ade1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:15.392549 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-1a4d1c97-99f3-4ce2-b5ff-d8eac829ade1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:15.404985 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-1a4d1c97-99f3-4ce2-b5ff-d8eac829ade1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1272 microversion: 2.1 time: 0.400914 Apr 30 13:21:15.406229 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 365/646] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:15 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1272 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:16.431643 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-7ce90595-d1a2-41ee-b5ce-71f0ffc26b25 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:16.434943 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-7ce90595-d1a2-41ee-b5ce-71f0ffc26b25 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:16.457580 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7ce90595-d1a2-41ee-b5ce-71f0ffc26b25 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:16.459313 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7ce90595-d1a2-41ee-b5ce-71f0ffc26b25 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:16.460964 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7ce90595-d1a2-41ee-b5ce-71f0ffc26b25 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:16.462038 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7ce90595-d1a2-41ee-b5ce-71f0ffc26b25 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:16.820713 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-7ce90595-d1a2-41ee-b5ce-71f0ffc26b25 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:16.831560 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-7ce90595-d1a2-41ee-b5ce-71f0ffc26b25 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1272 microversion: 2.1 time: 0.411272 Apr 30 13:21:16.832868 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 282/647] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:16 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1272 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:17.121395 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-c9134ff7-fc17-41a5-85c8-3538c76a9165 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Action: 'create', calling method: .version_select at 0x7f750022bee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-600591751", "metadata": {"Type": "work"}}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:21:17.729321 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-c9134ff7-fc17-41a5-85c8-3538c76a9165 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.744025 Apr 30 13:21:17.730129 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 366/648] 10.222.0.79 () {60 vars in 1156 bytes} [Fri Apr 30 13:21:16 2021] POST /compute/v2.1/os-volumes => generated 352 bytes in 746 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 30 13:21:17.742636 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-eed83da5-d77e-4a63-90c1-3637d09f53fd tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f75001e5c10>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:17.853406 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-4c938b02-b439-4c0a-aec1-f02640288efb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:17.854304 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-4c938b02-b439-4c0a-aec1-f02640288efb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:17.880594 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4c938b02-b439-4c0a-aec1-f02640288efb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:17.881178 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4c938b02-b439-4c0a-aec1-f02640288efb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:17.885047 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4c938b02-b439-4c0a-aec1-f02640288efb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:17.885679 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4c938b02-b439-4c0a-aec1-f02640288efb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:17.977771 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-eed83da5-d77e-4a63-90c1-3637d09f53fd tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.238732 Apr 30 13:21:17.978583 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 283/649] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:21:17 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:21:18.713983 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-4c938b02-b439-4c0a-aec1-f02640288efb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:18.726176 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-4c938b02-b439-4c0a-aec1-f02640288efb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1260 microversion: 2.1 time: 0.878125 Apr 30 13:21:18.726777 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 367/650] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:17 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1260 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:18.991584 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-610ed8c5-9650-4916-bc77-2e0c438c1ca7 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500bbcaf0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:19.098688 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-610ed8c5-9650-4916-bc77-2e0c438c1ca7 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 353 microversion: 2.1 time: 0.111331 Apr 30 13:21:19.099279 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 284/651] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:21:18 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 353 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:21:19.112171 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-f271c2d7-2f98-4572-b0b3-a41c029eafd8 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb7d6ee0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:19.221708 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-f271c2d7-2f98-4572-b0b3-a41c029eafd8 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 353 microversion: 2.1 time: 0.114235 Apr 30 13:21:19.224288 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 368/652] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:21:19 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 353 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:21:19.245050 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-a6de8945-0669-456e-b938-a2f208d05bff tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fbfc9a60>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:19.391523 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-a6de8945-0669-456e-b938-a2f208d05bff tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 202 len: 0 microversion: 2.1 time: 0.153623 Apr 30 13:21:19.395986 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 285/653] 10.222.0.79 () {58 vars in 1248 bytes} [Fri Apr 30 13:21:19 2021] DELETE /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:21:19.404252 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-2985cf5b-4e46-427f-8620-94329924823b tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f75001615e0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:19.533795 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-2985cf5b-4e46-427f-8620-94329924823b tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.136449 Apr 30 13:21:19.534603 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 369/654] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:21:19 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:21:19.744037 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-cdceccfd-9dde-45dd-9089-e0608c2f83ee tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:19.744648 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-cdceccfd-9dde-45dd-9089-e0608c2f83ee tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:19.753078 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cdceccfd-9dde-45dd-9089-e0608c2f83ee tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:19.753532 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cdceccfd-9dde-45dd-9089-e0608c2f83ee tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:19.754391 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cdceccfd-9dde-45dd-9089-e0608c2f83ee tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:19.754842 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cdceccfd-9dde-45dd-9089-e0608c2f83ee tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:20.037007 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-cdceccfd-9dde-45dd-9089-e0608c2f83ee tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:20.056858 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-cdceccfd-9dde-45dd-9089-e0608c2f83ee tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1260 microversion: 2.1 time: 0.316863 Apr 30 13:21:20.058418 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 286/655] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:19 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1260 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:20.547278 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-50864ee0-415c-4e78-9ec5-a0cf018e5cfe tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500146af0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:20.649695 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-50864ee0-415c-4e78-9ec5-a0cf018e5cfe tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.106268 Apr 30 13:21:20.650596 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 370/656] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:21:20 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:21:21.086244 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-e7ba2c4f-bee1-4e23-baaa-90ce7a01b58e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:21.086244 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-e7ba2c4f-bee1-4e23-baaa-90ce7a01b58e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:21.091309 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e7ba2c4f-bee1-4e23-baaa-90ce7a01b58e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:21.091761 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e7ba2c4f-bee1-4e23-baaa-90ce7a01b58e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:21.092738 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e7ba2c4f-bee1-4e23-baaa-90ce7a01b58e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:21.093182 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e7ba2c4f-bee1-4e23-baaa-90ce7a01b58e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:21.331016 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-e7ba2c4f-bee1-4e23-baaa-90ce7a01b58e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:21.340050 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-e7ba2c4f-bee1-4e23-baaa-90ce7a01b58e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1260 microversion: 2.1 time: 0.264748 Apr 30 13:21:21.340635 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 287/657] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:21 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1260 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:21.663176 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-6f50172e-6cba-436f-a9b3-fdb0ab0c0e2f tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500146160>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:21.766826 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-6f50172e-6cba-436f-a9b3-fdb0ab0c0e2f tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.107151 Apr 30 13:21:21.767658 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 371/658] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:21:21 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:21:22.358428 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-73d62b72-ea06-44ae-a0db-c8c8f09f92fe tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:22.359599 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-73d62b72-ea06-44ae-a0db-c8c8f09f92fe tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:22.369630 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-73d62b72-ea06-44ae-a0db-c8c8f09f92fe tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:22.370400 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-73d62b72-ea06-44ae-a0db-c8c8f09f92fe tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:22.371827 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-73d62b72-ea06-44ae-a0db-c8c8f09f92fe tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:22.372327 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-73d62b72-ea06-44ae-a0db-c8c8f09f92fe tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:22.627597 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-73d62b72-ea06-44ae-a0db-c8c8f09f92fe tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:22.637120 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-73d62b72-ea06-44ae-a0db-c8c8f09f92fe tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1260 microversion: 2.1 time: 0.282433 Apr 30 13:21:22.637850 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 288/659] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:22 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1260 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:22.779748 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-ba426dba-40f3-41df-8af6-9981dc7163db tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500161670>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:22.917910 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-ba426dba-40f3-41df-8af6-9981dc7163db tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.141878 Apr 30 13:21:22.918612 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 372/660] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:21:22 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:21:23.657306 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-3b02c260-3aaa-49b3-9fb0-719e32566bf9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:23.658721 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-3b02c260-3aaa-49b3-9fb0-719e32566bf9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:23.669098 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3b02c260-3aaa-49b3-9fb0-719e32566bf9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:23.670619 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3b02c260-3aaa-49b3-9fb0-719e32566bf9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:23.671625 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3b02c260-3aaa-49b3-9fb0-719e32566bf9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:23.672471 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3b02c260-3aaa-49b3-9fb0-719e32566bf9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:23.930949 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-d759bf42-1cc3-4d89-ad2b-12a9c31db3e2 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb7a4820>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:23.949847 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-3b02c260-3aaa-49b3-9fb0-719e32566bf9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:23.963518 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-3b02c260-3aaa-49b3-9fb0-719e32566bf9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1260 microversion: 2.1 time: 0.310228 Apr 30 13:21:23.968969 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 289/661] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:23 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1260 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:24.058807 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-d759bf42-1cc3-4d89-ad2b-12a9c31db3e2 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.131601 Apr 30 13:21:24.059519 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 373/662] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:21:23 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:21:24.457083 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-febdfe85-6e36-40e0-acc7-b8eb19b3585e tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'create', calling method: .version_select at 0x7f75001e5940>, body: {"keypair": {"name": "tempest-keypair-2018148527"}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:21:24.480371 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.quota [None req-febdfe85-6e36-40e0-acc7-b8eb19b3585e tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Getting quotas for project 795985fdb0c545438436572c0f48ee24. Resources: {'key_pairs'} {{(pid=87932) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:21:24.484532 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.quota [None req-febdfe85-6e36-40e0-acc7-b8eb19b3585e tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Getting quotas for user a0f2e072f58341ac85f9f856603b0dc9 and project 795985fdb0c545438436572c0f48ee24. Resources: {'key_pairs'} {{(pid=87932) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:21:24.654312 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.quota [None req-febdfe85-6e36-40e0-acc7-b8eb19b3585e tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Getting quotas for project 795985fdb0c545438436572c0f48ee24. Resources: {'key_pairs'} {{(pid=87932) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:21:24.661651 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.quota [None req-febdfe85-6e36-40e0-acc7-b8eb19b3585e tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Getting quotas for user a0f2e072f58341ac85f9f856603b0dc9 and project 795985fdb0c545438436572c0f48ee24. Resources: {'key_pairs'} {{(pid=87932) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:21:24.678803 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-febdfe85-6e36-40e0-acc7-b8eb19b3585e tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.284778 Apr 30 13:21:24.679402 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 290/663] 10.222.0.79 () {60 vars in 1158 bytes} [Fri Apr 30 13:21:24 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:24.983208 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-31cdfd18-fa13-4e7b-ae40-ee4c5d18adef tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:24.983902 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-31cdfd18-fa13-4e7b-ae40-ee4c5d18adef tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:24.992316 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-31cdfd18-fa13-4e7b-ae40-ee4c5d18adef tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:24.992848 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-31cdfd18-fa13-4e7b-ae40-ee4c5d18adef tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:24.993706 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-31cdfd18-fa13-4e7b-ae40-ee4c5d18adef tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:24.994397 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-31cdfd18-fa13-4e7b-ae40-ee4c5d18adef tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:25.074163 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-d3d3e141-d615-4986-93f9-08f7fc383923 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750005e5e0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:25.227325 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-d3d3e141-d615-4986-93f9-08f7fc383923 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.158022 Apr 30 13:21:25.227907 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 291/664] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:21:25 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:21:25.304636 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-31cdfd18-fa13-4e7b-ae40-ee4c5d18adef tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:25.313314 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-31cdfd18-fa13-4e7b-ae40-ee4c5d18adef tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1260 microversion: 2.1 time: 0.333833 Apr 30 13:21:25.314402 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 374/665] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:24 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1260 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:26.240145 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-8fb20821-6f15-42db-a844-15bd573cf861 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500bbcd30>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:26.331262 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-62a4ceec-dcc3-472e-85c5-9565217d1d62 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:26.333089 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-62a4ceec-dcc3-472e-85c5-9565217d1d62 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:26.346165 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-62a4ceec-dcc3-472e-85c5-9565217d1d62 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:26.349433 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-62a4ceec-dcc3-472e-85c5-9565217d1d62 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:26.350542 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-62a4ceec-dcc3-472e-85c5-9565217d1d62 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:26.351226 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-62a4ceec-dcc3-472e-85c5-9565217d1d62 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:26.387131 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-8fb20821-6f15-42db-a844-15bd573cf861 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.150679 Apr 30 13:21:26.391774 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 292/666] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:21:26 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:21:26.774923 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-62a4ceec-dcc3-472e-85c5-9565217d1d62 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:26.785041 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-62a4ceec-dcc3-472e-85c5-9565217d1d62 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1260 microversion: 2.1 time: 0.458115 Apr 30 13:21:26.787870 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 375/667] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:26 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1260 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:26.900777 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-74b426e2-efd0-4fd9-979e-4ecf3ee49b19 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1595847068", "imageRef": "705a0c6b-b003-4687-84bf-8b9f87dae39e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0cc87707-d905-4c01-8755-7767acf4ce00"}], "security_groups": [{"name": "tempest-securitygroup--508372516"}], "key_name": "tempest-keypair-2018148527", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:21:27.045073 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.network.neutron [None req-74b426e2-efd0-4fd9-979e-4ecf3ee49b19 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] validate_networks() for [('0cc87707-d905-4c01-8755-7767acf4ce00', None, None, None)] {{(pid=87932) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 13:21:27.402279 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-ff11e72a-1ee3-445e-9674-3a14d8233513 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb7d6280>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:27.525217 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-ff11e72a-1ee3-445e-9674-3a14d8233513 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.128465 Apr 30 13:21:27.526277 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 376/668] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:21:27 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:21:27.739427 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-74b426e2-efd0-4fd9-979e-4ecf3ee49b19 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Flavor limits 0:0:0 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 13:21:27.739895 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-74b426e2-efd0-4fd9-979e-4ecf3ee49b19 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Image limits 0:0:0 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 13:21:27.740364 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-74b426e2-efd0-4fd9-979e-4ecf3ee49b19 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Flavor pref 0:0:0 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 13:21:27.740781 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-74b426e2-efd0-4fd9-979e-4ecf3ee49b19 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Image pref 0:0:0 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 13:21:27.741199 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-74b426e2-efd0-4fd9-979e-4ecf3ee49b19 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 13:21:27.751242 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-74b426e2-efd0-4fd9-979e-4ecf3ee49b19 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:27.751852 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-74b426e2-efd0-4fd9-979e-4ecf3ee49b19 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:27.752793 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-74b426e2-efd0-4fd9-979e-4ecf3ee49b19 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:27.753366 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-74b426e2-efd0-4fd9-979e-4ecf3ee49b19 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:27.773846 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.quota [None req-74b426e2-efd0-4fd9-979e-4ecf3ee49b19 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Getting quotas for project 795985fdb0c545438436572c0f48ee24. Resources: {'ram', 'instances', 'cores'} {{(pid=87932) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:21:27.780307 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.quota [None req-74b426e2-efd0-4fd9-979e-4ecf3ee49b19 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Getting quotas for user a0f2e072f58341ac85f9f856603b0dc9 and project 795985fdb0c545438436572c0f48ee24. Resources: {'ram', 'instances', 'cores'} {{(pid=87932) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:21:27.793834 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-74b426e2-efd0-4fd9-979e-4ecf3ee49b19 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Going to run 1 instances... {{(pid=87932) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 13:21:27.798844 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-74b426e2-efd0-4fd9-979e-4ecf3ee49b19 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 51ec80af-a515-409f-a251-9d0a9718889b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='705a0c6b-b003-4687-84bf-8b9f87dae39e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=87932) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 13:21:27.803530 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-dad084bd-0ecb-483f-b250-678cd273e0a8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:27.804369 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-dad084bd-0ecb-483f-b250-678cd273e0a8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:27.812793 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-dad084bd-0ecb-483f-b250-678cd273e0a8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:27.813926 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-dad084bd-0ecb-483f-b250-678cd273e0a8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:27.815181 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-dad084bd-0ecb-483f-b250-678cd273e0a8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:27.815632 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-dad084bd-0ecb-483f-b250-678cd273e0a8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:27.861007 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-74b426e2-efd0-4fd9-979e-4ecf3ee49b19 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.963497 Apr 30 13:21:27.867561 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 293/669] 10.222.0.79 () {60 vars in 1147 bytes} [Fri Apr 30 13:21:26 2021] POST /compute/v2.1/servers => generated 401 bytes in 972 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 13:21:27.873099 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-ca6242f6-57a3-4908-a19d-266a5f7af3bf tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:27.874023 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-ca6242f6-57a3-4908-a19d-266a5f7af3bf tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 51ec80af-a515-409f-a251-9d0a9718889b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:27.957423 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-ca6242f6-57a3-4908-a19d-266a5f7af3bf tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f2e072f58341ac85f9f856603b0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795985fdb0c545438436572c0f48ee24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:27.971152 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-ca6242f6-57a3-4908-a19d-266a5f7af3bf tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "GET /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b" status: 200 len: 1238 microversion: 2.1 time: 0.101946 Apr 30 13:21:27.972074 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 294/670] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:27 2021] GET /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b => generated 1238 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:28.059847 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-dad084bd-0ecb-483f-b250-678cd273e0a8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:28.074187 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-dad084bd-0ecb-483f-b250-678cd273e0a8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1260 microversion: 2.1 time: 0.274298 Apr 30 13:21:28.074782 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 377/671] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:27 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1260 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:21:28.541597 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-4065567e-c777-40df-bc71-d357582ef4f4 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750024fca0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:28.677814 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-4065567e-c777-40df-bc71-d357582ef4f4 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.143342 Apr 30 13:21:28.678723 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 295/672] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:21:28 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:21:28.989324 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-244e6120-9e10-4f28-bab4-6afc96ef1ca9 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:28.989946 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-244e6120-9e10-4f28-bab4-6afc96ef1ca9 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 51ec80af-a515-409f-a251-9d0a9718889b] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:28.997898 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-244e6120-9e10-4f28-bab4-6afc96ef1ca9 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:28.998410 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-244e6120-9e10-4f28-bab4-6afc96ef1ca9 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:28.999191 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-244e6120-9e10-4f28-bab4-6afc96ef1ca9 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:28.999643 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-244e6120-9e10-4f28-bab4-6afc96ef1ca9 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:29.091746 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-521f447e-b22b-41b3-a954-6060bd0643a9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:29.092453 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-521f447e-b22b-41b3-a954-6060bd0643a9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:29.100425 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-521f447e-b22b-41b3-a954-6060bd0643a9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:29.100925 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-521f447e-b22b-41b3-a954-6060bd0643a9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:29.101739 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-521f447e-b22b-41b3-a954-6060bd0643a9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:29.102231 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-521f447e-b22b-41b3-a954-6060bd0643a9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:29.138283 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-244e6120-9e10-4f28-bab4-6afc96ef1ca9 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f2e072f58341ac85f9f856603b0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795985fdb0c545438436572c0f48ee24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:29.146705 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-244e6120-9e10-4f28-bab4-6afc96ef1ca9 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "GET /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b" status: 200 len: 1290 microversion: 2.1 time: 0.161842 Apr 30 13:21:29.147296 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 378/673] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:28 2021] GET /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b => generated 1290 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:29.486858 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-521f447e-b22b-41b3-a954-6060bd0643a9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:29.495555 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-521f447e-b22b-41b3-a954-6060bd0643a9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1260 microversion: 2.1 time: 0.408165 Apr 30 13:21:29.496496 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 296/674] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:29 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1260 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:21:29.690731 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-1b3a4d55-8101-43b9-975a-232952c2f86d tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb7d6700>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:29.788569 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-1b3a4d55-8101-43b9-975a-232952c2f86d tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.101336 Apr 30 13:21:29.790129 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 379/675] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:21:29 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:21:30.164263 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-94201be3-3361-46d5-8887-463689f8c631 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:30.164981 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-94201be3-3361-46d5-8887-463689f8c631 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 51ec80af-a515-409f-a251-9d0a9718889b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:30.174384 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-94201be3-3361-46d5-8887-463689f8c631 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:30.174842 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-94201be3-3361-46d5-8887-463689f8c631 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:30.175659 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-94201be3-3361-46d5-8887-463689f8c631 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:30.176101 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-94201be3-3361-46d5-8887-463689f8c631 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:30.514145 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-1e6a2541-16de-4ab7-88cb-b0b78fa13ef0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:30.515001 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-1e6a2541-16de-4ab7-88cb-b0b78fa13ef0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:30.526812 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1e6a2541-16de-4ab7-88cb-b0b78fa13ef0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:30.527350 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1e6a2541-16de-4ab7-88cb-b0b78fa13ef0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:30.528398 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1e6a2541-16de-4ab7-88cb-b0b78fa13ef0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:30.528921 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1e6a2541-16de-4ab7-88cb-b0b78fa13ef0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:30.569923 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-94201be3-3361-46d5-8887-463689f8c631 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f2e072f58341ac85f9f856603b0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795985fdb0c545438436572c0f48ee24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:30.584334 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-94201be3-3361-46d5-8887-463689f8c631 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "GET /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b" status: 200 len: 1363 microversion: 2.1 time: 0.423978 Apr 30 13:21:30.585102 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 297/676] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:30 2021] GET /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b => generated 1363 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:30.764556 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-1e6a2541-16de-4ab7-88cb-b0b78fa13ef0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:30.776908 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-1e6a2541-16de-4ab7-88cb-b0b78fa13ef0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1260 microversion: 2.1 time: 0.267378 Apr 30 13:21:30.777498 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 380/677] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:30 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1260 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:30.801621 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-e96ec3ba-f06d-4892-b3b6-fab3e3c941b5 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750024f310>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:30.898465 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-e96ec3ba-f06d-4892-b3b6-fab3e3c941b5 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.101002 Apr 30 13:21:30.899053 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 298/678] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:21:30 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:21:31.394838 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [req-f4e9a62e-f442-4c56-830b-a6f17c991840 req-6230ab58-9426-4e57-b5db-60a773740d99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51ec80af-a515-409f-a251-9d0a9718889b", "tag": "a66cfb5b-8d13-4a42-a6be-066e52aaf9b2"}]} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:21:31.396492 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:21:31.396492 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: warnings.warn(msg) Apr 30 13:21:31.413306 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-f4e9a62e-f442-4c56-830b-a6f17c991840 req-6230ab58-9426-4e57-b5db-60a773740d99 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:31.413773 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-f4e9a62e-f442-4c56-830b-a6f17c991840 req-6230ab58-9426-4e57-b5db-60a773740d99 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:31.431950 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.compute.server_external_events [req-f4e9a62e-f442-4c56-830b-a6f17c991840 req-6230ab58-9426-4e57-b5db-60a773740d99 service nova] Creating event network-changed:a66cfb5b-8d13-4a42-a6be-066e52aaf9b2 for instance 51ec80af-a515-409f-a251-9d0a9718889b on hv-cinder-78836 Apr 30 13:21:31.437469 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [req-f4e9a62e-f442-4c56-830b-a6f17c991840 req-6230ab58-9426-4e57-b5db-60a773740d99 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046936 Apr 30 13:21:31.438205 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 381/679] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:21:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:21:31.601321 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-54c0774a-fc53-4a20-ac72-491bb0be9d33 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:31.601920 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-54c0774a-fc53-4a20-ac72-491bb0be9d33 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 51ec80af-a515-409f-a251-9d0a9718889b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:31.609639 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-54c0774a-fc53-4a20-ac72-491bb0be9d33 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:31.610131 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-54c0774a-fc53-4a20-ac72-491bb0be9d33 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:31.610924 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-54c0774a-fc53-4a20-ac72-491bb0be9d33 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:31.611374 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-54c0774a-fc53-4a20-ac72-491bb0be9d33 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:31.794669 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-7fb713cb-7835-4a10-9fa8-56cbec343212 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:31.795642 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-7fb713cb-7835-4a10-9fa8-56cbec343212 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:31.803805 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7fb713cb-7835-4a10-9fa8-56cbec343212 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:31.804352 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7fb713cb-7835-4a10-9fa8-56cbec343212 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:31.805220 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7fb713cb-7835-4a10-9fa8-56cbec343212 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:31.806122 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7fb713cb-7835-4a10-9fa8-56cbec343212 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:32.026543 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-54c0774a-fc53-4a20-ac72-491bb0be9d33 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f2e072f58341ac85f9f856603b0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795985fdb0c545438436572c0f48ee24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:32.029739 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-7fb713cb-7835-4a10-9fa8-56cbec343212 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:32.035554 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-54c0774a-fc53-4a20-ac72-491bb0be9d33 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "GET /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b" status: 200 len: 1363 microversion: 2.1 time: 0.437895 Apr 30 13:21:32.036523 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 299/680] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:31 2021] GET /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b => generated 1363 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:32.041208 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-5d8aa6b9-eed1-4530-9acb-bb1b3b92dcec tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500bffca0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:32.041374 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-7fb713cb-7835-4a10-9fa8-56cbec343212 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1260 microversion: 2.1 time: 0.250876 Apr 30 13:21:32.041874 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 382/681] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:31 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1260 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:21:32.142727 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-5d8aa6b9-eed1-4530-9acb-bb1b3b92dcec tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.104907 Apr 30 13:21:32.143468 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 300/682] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:21:32 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:21:33.059529 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-5a587eeb-0622-4e42-920a-dabbd8e96c25 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:33.060272 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-5a587eeb-0622-4e42-920a-dabbd8e96c25 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:33.060545 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-4f93c083-6b7d-496d-92d1-73e73b9f0364 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:33.061295 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-4f93c083-6b7d-496d-92d1-73e73b9f0364 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 51ec80af-a515-409f-a251-9d0a9718889b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:33.068345 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5a587eeb-0622-4e42-920a-dabbd8e96c25 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:33.068894 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5a587eeb-0622-4e42-920a-dabbd8e96c25 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:33.069253 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4f93c083-6b7d-496d-92d1-73e73b9f0364 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:33.069781 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4f93c083-6b7d-496d-92d1-73e73b9f0364 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:33.069907 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5a587eeb-0622-4e42-920a-dabbd8e96c25 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:33.070438 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5a587eeb-0622-4e42-920a-dabbd8e96c25 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:33.070801 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4f93c083-6b7d-496d-92d1-73e73b9f0364 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:33.071313 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4f93c083-6b7d-496d-92d1-73e73b9f0364 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:33.273598 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-5a587eeb-0622-4e42-920a-dabbd8e96c25 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:33.277507 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-4f93c083-6b7d-496d-92d1-73e73b9f0364 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f2e072f58341ac85f9f856603b0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795985fdb0c545438436572c0f48ee24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:33.282812 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-5a587eeb-0622-4e42-920a-dabbd8e96c25 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1260 microversion: 2.1 time: 0.226854 Apr 30 13:21:33.283633 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 383/683] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:33 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1260 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:33.288038 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-4f93c083-6b7d-496d-92d1-73e73b9f0364 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "GET /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b" status: 200 len: 1363 microversion: 2.1 time: 0.231283 Apr 30 13:21:33.288619 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 301/684] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:33 2021] GET /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b => generated 1363 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:21:33.289133 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-413b6249-5e23-46fb-8b5b-4b3ecf9951f5 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb7a4160>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:33.382928 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-413b6249-5e23-46fb-8b5b-4b3ecf9951f5 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.098213 Apr 30 13:21:33.383611 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 384/685] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:21:33 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:21:34.303921 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-91d2efdb-e6c2-4135-a66f-47ce2b6f05e7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:34.304799 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-91d2efdb-e6c2-4135-a66f-47ce2b6f05e7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:34.304927 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-8b4fdac4-5e53-4015-8557-fb7ae1d847dd tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:34.305549 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-8b4fdac4-5e53-4015-8557-fb7ae1d847dd tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 51ec80af-a515-409f-a251-9d0a9718889b] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:34.311723 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-91d2efdb-e6c2-4135-a66f-47ce2b6f05e7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:34.312174 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-91d2efdb-e6c2-4135-a66f-47ce2b6f05e7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:34.312880 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8b4fdac4-5e53-4015-8557-fb7ae1d847dd tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:34.313078 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-91d2efdb-e6c2-4135-a66f-47ce2b6f05e7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:34.313342 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8b4fdac4-5e53-4015-8557-fb7ae1d847dd tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:34.313664 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-91d2efdb-e6c2-4135-a66f-47ce2b6f05e7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:34.314157 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8b4fdac4-5e53-4015-8557-fb7ae1d847dd tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:34.314603 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8b4fdac4-5e53-4015-8557-fb7ae1d847dd tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:34.552534 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-91d2efdb-e6c2-4135-a66f-47ce2b6f05e7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:34.562584 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-91d2efdb-e6c2-4135-a66f-47ce2b6f05e7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1260 microversion: 2.1 time: 0.262567 Apr 30 13:21:34.563312 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 302/686] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:34 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1260 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:21:34.568078 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-81e53fda-540d-490d-910b-980570e2519b tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fbfc9ca0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:34.597004 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-8b4fdac4-5e53-4015-8557-fb7ae1d847dd tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f2e072f58341ac85f9f856603b0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795985fdb0c545438436572c0f48ee24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:34.606669 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-8b4fdac4-5e53-4015-8557-fb7ae1d847dd tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "GET /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b" status: 200 len: 1363 microversion: 2.1 time: 0.305607 Apr 30 13:21:34.607298 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 385/687] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:34 2021] GET /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b => generated 1363 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:21:34.675374 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-81e53fda-540d-490d-910b-980570e2519b tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.110732 Apr 30 13:21:34.675990 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 303/688] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:21:34 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:21:35.580034 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-ba9ad5cd-215b-4c64-b1a8-0dc0d274a691 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:35.580675 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-ba9ad5cd-215b-4c64-b1a8-0dc0d274a691 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:35.589098 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ba9ad5cd-215b-4c64-b1a8-0dc0d274a691 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:35.589559 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ba9ad5cd-215b-4c64-b1a8-0dc0d274a691 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:35.590392 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ba9ad5cd-215b-4c64-b1a8-0dc0d274a691 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:35.590835 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ba9ad5cd-215b-4c64-b1a8-0dc0d274a691 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:35.631369 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-5ddc8708-856a-4509-a620-33d24342295e tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:35.631942 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-5ddc8708-856a-4509-a620-33d24342295e tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 51ec80af-a515-409f-a251-9d0a9718889b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:35.639291 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5ddc8708-856a-4509-a620-33d24342295e tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:35.639744 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5ddc8708-856a-4509-a620-33d24342295e tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:35.640565 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5ddc8708-856a-4509-a620-33d24342295e tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:35.641589 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5ddc8708-856a-4509-a620-33d24342295e tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:35.800494 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-ba9ad5cd-215b-4c64-b1a8-0dc0d274a691 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:35.808795 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-ba9ad5cd-215b-4c64-b1a8-0dc0d274a691 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1260 microversion: 2.1 time: 0.232562 Apr 30 13:21:35.819218 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 386/689] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:35 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1260 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:35.824396 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-3f3018db-45ee-4e49-a087-9ab58cce0dcf tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500146a60>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:35.857050 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-5ddc8708-856a-4509-a620-33d24342295e tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f2e072f58341ac85f9f856603b0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795985fdb0c545438436572c0f48ee24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:35.867356 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-5ddc8708-856a-4509-a620-33d24342295e tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "GET /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b" status: 200 len: 1363 microversion: 2.1 time: 0.240682 Apr 30 13:21:35.868631 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 304/690] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:35 2021] GET /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:21:35.935022 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-3f3018db-45ee-4e49-a087-9ab58cce0dcf tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.114304 Apr 30 13:21:35.935601 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 387/691] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:21:35 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:21:36.012029 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [req-337e37f9-6153-4edd-bae7-0b5ac09de9d5 req-84b6c86c-0779-4197-afdf-159f15d50c90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51ec80af-a515-409f-a251-9d0a9718889b", "name": "network-vif-plugged", "status": "completed", "tag": "a66cfb5b-8d13-4a42-a6be-066e52aaf9b2"}]} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:21:36.013903 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:21:36.013903 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: warnings.warn(msg) Apr 30 13:21:36.022732 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-337e37f9-6153-4edd-bae7-0b5ac09de9d5 req-84b6c86c-0779-4197-afdf-159f15d50c90 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:36.023190 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-337e37f9-6153-4edd-bae7-0b5ac09de9d5 req-84b6c86c-0779-4197-afdf-159f15d50c90 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:36.039498 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.compute.server_external_events [req-337e37f9-6153-4edd-bae7-0b5ac09de9d5 req-84b6c86c-0779-4197-afdf-159f15d50c90 service nova] Creating event network-vif-plugged:a66cfb5b-8d13-4a42-a6be-066e52aaf9b2 for instance 51ec80af-a515-409f-a251-9d0a9718889b on hv-cinder-78836 Apr 30 13:21:36.044344 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [req-337e37f9-6153-4edd-bae7-0b5ac09de9d5 req-84b6c86c-0779-4197-afdf-159f15d50c90 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036397 Apr 30 13:21:36.045152 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 305/692] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:21:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:21:36.825639 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-a4c73914-89d9-4d15-91d2-85661fd8df4d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:36.826393 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-a4c73914-89d9-4d15-91d2-85661fd8df4d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:36.834559 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a4c73914-89d9-4d15-91d2-85661fd8df4d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:36.835020 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a4c73914-89d9-4d15-91d2-85661fd8df4d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:36.835852 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a4c73914-89d9-4d15-91d2-85661fd8df4d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:36.836296 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a4c73914-89d9-4d15-91d2-85661fd8df4d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:36.885111 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-463535d1-48da-4c9f-883b-31049106cb91 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:36.885842 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-463535d1-48da-4c9f-883b-31049106cb91 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 51ec80af-a515-409f-a251-9d0a9718889b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:36.894706 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-463535d1-48da-4c9f-883b-31049106cb91 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:36.895159 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-463535d1-48da-4c9f-883b-31049106cb91 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:36.895950 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-463535d1-48da-4c9f-883b-31049106cb91 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:36.896395 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-463535d1-48da-4c9f-883b-31049106cb91 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:37.119280 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-a4c73914-89d9-4d15-91d2-85661fd8df4d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:37.128259 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-a4c73914-89d9-4d15-91d2-85661fd8df4d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1260 microversion: 2.1 time: 0.306314 Apr 30 13:21:37.128942 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 388/693] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:36 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1260 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:37.133772 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-c325a360-a319-4459-95d4-59234151a792 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750022b670>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:37.191898 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-463535d1-48da-4c9f-883b-31049106cb91 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f2e072f58341ac85f9f856603b0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795985fdb0c545438436572c0f48ee24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:37.200735 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-463535d1-48da-4c9f-883b-31049106cb91 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "GET /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b" status: 200 len: 1363 microversion: 2.1 time: 0.319705 Apr 30 13:21:37.201328 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 306/694] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:36 2021] GET /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b => generated 1363 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:21:37.230191 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-c325a360-a319-4459-95d4-59234151a792 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.099841 Apr 30 13:21:37.230766 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 389/695] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:21:37 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:21:38.144968 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-1f7ed8ed-6db1-4792-91a2-412594a0f276 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:38.145511 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-1f7ed8ed-6db1-4792-91a2-412594a0f276 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:38.152923 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1f7ed8ed-6db1-4792-91a2-412594a0f276 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:38.153376 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1f7ed8ed-6db1-4792-91a2-412594a0f276 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:38.154215 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1f7ed8ed-6db1-4792-91a2-412594a0f276 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:38.154660 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1f7ed8ed-6db1-4792-91a2-412594a0f276 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:38.218059 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-03cacb16-281e-4cdc-ade8-a3888e10bc09 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:38.218702 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-03cacb16-281e-4cdc-ade8-a3888e10bc09 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 51ec80af-a515-409f-a251-9d0a9718889b] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:38.227643 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-03cacb16-281e-4cdc-ade8-a3888e10bc09 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:38.227643 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-03cacb16-281e-4cdc-ade8-a3888e10bc09 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:38.228523 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-03cacb16-281e-4cdc-ade8-a3888e10bc09 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:38.228874 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-03cacb16-281e-4cdc-ade8-a3888e10bc09 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:38.431688 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-03cacb16-281e-4cdc-ade8-a3888e10bc09 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f2e072f58341ac85f9f856603b0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795985fdb0c545438436572c0f48ee24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:38.440987 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-03cacb16-281e-4cdc-ade8-a3888e10bc09 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "GET /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b" status: 200 len: 1549 microversion: 2.1 time: 0.226588 Apr 30 13:21:38.441566 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 390/696] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:38 2021] GET /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b => generated 1549 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:21:38.446335 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-58ebc0be-8534-4381-8afe-25a3ae33496c tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb7d6940>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:38.470912 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-1f7ed8ed-6db1-4792-91a2-412594a0f276 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:38.479254 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-1f7ed8ed-6db1-4792-91a2-412594a0f276 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1260 microversion: 2.1 time: 0.338682 Apr 30 13:21:38.479823 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 307/697] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:38 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1260 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:21:38.485238 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-e468efc6-5841-4b1c-8428-344aabf8b133 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:38.485900 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-e468efc6-5841-4b1c-8428-344aabf8b133 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 51ec80af-a515-409f-a251-9d0a9718889b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:38.493063 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e468efc6-5841-4b1c-8428-344aabf8b133 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:38.493679 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e468efc6-5841-4b1c-8428-344aabf8b133 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:38.494506 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e468efc6-5841-4b1c-8428-344aabf8b133 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:38.494945 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e468efc6-5841-4b1c-8428-344aabf8b133 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:38.540964 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-58ebc0be-8534-4381-8afe-25a3ae33496c tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.098046 Apr 30 13:21:38.541653 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 391/698] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:21:38 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:21:38.644357 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-e468efc6-5841-4b1c-8428-344aabf8b133 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "GET /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.163186 Apr 30 13:21:38.644958 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 308/699] 10.222.0.79 () {58 vars in 1275 bytes} [Fri Apr 30 13:21:38 2021] GET /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/os-interface => generated 284 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:21:39.487497 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-a9381da0-f1fa-4513-9f40-da00e25b7043 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:39.488080 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-a9381da0-f1fa-4513-9f40-da00e25b7043 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:39.496978 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-ad2486a8-3b8d-4e92-92b1-820388e098d3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:39.497704 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-ad2486a8-3b8d-4e92-92b1-820388e098d3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:39.502542 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a9381da0-f1fa-4513-9f40-da00e25b7043 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:39.503787 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a9381da0-f1fa-4513-9f40-da00e25b7043 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:39.504837 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a9381da0-f1fa-4513-9f40-da00e25b7043 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:39.505694 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a9381da0-f1fa-4513-9f40-da00e25b7043 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:39.507204 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ad2486a8-3b8d-4e92-92b1-820388e098d3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:39.507739 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ad2486a8-3b8d-4e92-92b1-820388e098d3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:39.508607 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ad2486a8-3b8d-4e92-92b1-820388e098d3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:39.510047 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ad2486a8-3b8d-4e92-92b1-820388e098d3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:39.599553 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-a9381da0-f1fa-4513-9f40-da00e25b7043 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/os-volume_attachments/9021a8f8-b014-4bb9-af1d-f8c3df7a88bc" status: 200 len: 194 microversion: 2.20 time: 0.116627 Apr 30 13:21:39.600180 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 392/700] 10.222.0.79 () {60 vars in 1454 bytes} [Fri Apr 30 13:21:39 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/os-volume_attachments/9021a8f8-b014-4bb9-af1d-f8c3df7a88bc => generated 194 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:21:39.604667 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-8ecebffc-ccfa-46c7-82e5-986dd796d3d5 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb7a4ca0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:39.711985 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-8ecebffc-ccfa-46c7-82e5-986dd796d3d5 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.106243 Apr 30 13:21:39.711985 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 393/701] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:21:39 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:21:39.720342 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-e694ef9e-2e17-4af7-8880-7d74210b5efa tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:39.721095 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-e694ef9e-2e17-4af7-8880-7d74210b5efa tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:39.731699 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e694ef9e-2e17-4af7-8880-7d74210b5efa tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:39.732160 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e694ef9e-2e17-4af7-8880-7d74210b5efa tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:39.732983 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e694ef9e-2e17-4af7-8880-7d74210b5efa tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:39.733435 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e694ef9e-2e17-4af7-8880-7d74210b5efa tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:39.905946 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.objects.instance [None req-e694ef9e-2e17-4af7-8880-7d74210b5efa tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lazy-loading 'services' on Instance uuid ad3419a7-71af-4a52-bcb7-6048e0553df9 {{(pid=87933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:21:40.113485 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-ad2486a8-3b8d-4e92-92b1-820388e098d3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:40.123808 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-ad2486a8-3b8d-4e92-92b1-820388e098d3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1260 microversion: 2.1 time: 0.630826 Apr 30 13:21:40.130425 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 309/702] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:39 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1260 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:40.172680 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-e694ef9e-2e17-4af7-8880-7d74210b5efa tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/os-volume_attachments/9021a8f8-b014-4bb9-af1d-f8c3df7a88bc" status: 202 len: 0 microversion: 2.20 time: 0.458195 Apr 30 13:21:40.173818 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 394/703] 10.222.0.79 () {60 vars in 1457 bytes} [Fri Apr 30 13:21:39 2021] DELETE /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9/os-volume_attachments/9021a8f8-b014-4bb9-af1d-f8c3df7a88bc => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 30 13:21:40.603574 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-740e8feb-eb55-4d9b-b62d-755860d78847 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:21:40.604717 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-740e8feb-eb55-4d9b-b62d-755860d78847 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 51ec80af-a515-409f-a251-9d0a9718889b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:40.607493 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [req-c26f953f-1fed-4973-acf9-50966d898465 req-f555ee5a-ae6b-4b85-ab3a-d802fbbedc95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51ec80af-a515-409f-a251-9d0a9718889b", "tag": "a66cfb5b-8d13-4a42-a6be-066e52aaf9b2"}]} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:21:40.614519 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-740e8feb-eb55-4d9b-b62d-755860d78847 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:40.614973 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-740e8feb-eb55-4d9b-b62d-755860d78847 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:40.616128 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-740e8feb-eb55-4d9b-b62d-755860d78847 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:40.616570 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-740e8feb-eb55-4d9b-b62d-755860d78847 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:40.617180 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:21:40.617180 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: warnings.warn(msg) Apr 30 13:21:40.629325 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-c26f953f-1fed-4973-acf9-50966d898465 req-f555ee5a-ae6b-4b85-ab3a-d802fbbedc95 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:40.630120 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-c26f953f-1fed-4973-acf9-50966d898465 req-f555ee5a-ae6b-4b85-ab3a-d802fbbedc95 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:40.655396 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.compute.server_external_events [req-c26f953f-1fed-4973-acf9-50966d898465 req-f555ee5a-ae6b-4b85-ab3a-d802fbbedc95 service nova] Creating event network-changed:a66cfb5b-8d13-4a42-a6be-066e52aaf9b2 for instance 51ec80af-a515-409f-a251-9d0a9718889b on hv-cinder-78836 Apr 30 13:21:40.664276 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [req-c26f953f-1fed-4973-acf9-50966d898465 req-f555ee5a-ae6b-4b85-ab3a-d802fbbedc95 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062781 Apr 30 13:21:40.665597 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 395/704] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:21:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:21:40.720850 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-62e9b706-51d2-444e-903a-853375b0f0cb tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500161670>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:40.751144 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-740e8feb-eb55-4d9b-b62d-755860d78847 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action" status: 200 len: 14 microversion: 2.1 time: 0.151577 Apr 30 13:21:40.752757 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 310/705] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:21:40 2021] POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action => generated 14 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 13:21:40.859116 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-62e9b706-51d2-444e-903a-853375b0f0cb tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.143103 Apr 30 13:21:40.860264 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 396/706] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:21:40 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:21:41.146517 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-bd1de407-2c0b-4817-9fbb-d18a9643ecc2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:41.147499 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-bd1de407-2c0b-4817-9fbb-d18a9643ecc2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:41.156315 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-bd1de407-2c0b-4817-9fbb-d18a9643ecc2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:41.157147 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-bd1de407-2c0b-4817-9fbb-d18a9643ecc2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:41.158324 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-bd1de407-2c0b-4817-9fbb-d18a9643ecc2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:41.158935 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-bd1de407-2c0b-4817-9fbb-d18a9643ecc2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:41.696054 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-bd1de407-2c0b-4817-9fbb-d18a9643ecc2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:41.712704 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-bd1de407-2c0b-4817-9fbb-d18a9643ecc2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1260 microversion: 2.1 time: 0.570486 Apr 30 13:21:41.713840 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 311/707] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:41 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1260 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:41.765123 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-307859bb-836b-4e27-96eb-8420b4d5b683 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:21:41.767377 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-307859bb-836b-4e27-96eb-8420b4d5b683 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 51ec80af-a515-409f-a251-9d0a9718889b] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:41.780688 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-307859bb-836b-4e27-96eb-8420b4d5b683 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:41.781797 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-307859bb-836b-4e27-96eb-8420b4d5b683 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:41.783225 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-307859bb-836b-4e27-96eb-8420b4d5b683 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:41.784072 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-307859bb-836b-4e27-96eb-8420b4d5b683 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:41.878084 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-d072187e-90d9-47e2-acff-726b79adac19 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500bbc9d0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:41.908862 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-307859bb-836b-4e27-96eb-8420b4d5b683 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action" status: 200 len: 14 microversion: 2.1 time: 0.147647 Apr 30 13:21:41.909491 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 397/708] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:21:41 2021] POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action => generated 14 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 30 13:21:41.979898 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-d072187e-90d9-47e2-acff-726b79adac19 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.107437 Apr 30 13:21:41.980706 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 312/709] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:21:41 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:21:42.732491 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-4a7c0852-ddab-42f4-9357-5a1cc8fa1892 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:42.733111 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-4a7c0852-ddab-42f4-9357-5a1cc8fa1892 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:42.742049 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4a7c0852-ddab-42f4-9357-5a1cc8fa1892 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:42.742503 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4a7c0852-ddab-42f4-9357-5a1cc8fa1892 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:42.743299 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4a7c0852-ddab-42f4-9357-5a1cc8fa1892 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:42.743795 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4a7c0852-ddab-42f4-9357-5a1cc8fa1892 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:42.920713 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-7cc76f85-d288-4d2d-a75a-feef051f9d50 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:21:42.921735 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-7cc76f85-d288-4d2d-a75a-feef051f9d50 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 51ec80af-a515-409f-a251-9d0a9718889b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:42.930120 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7cc76f85-d288-4d2d-a75a-feef051f9d50 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:42.930636 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7cc76f85-d288-4d2d-a75a-feef051f9d50 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:42.931386 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7cc76f85-d288-4d2d-a75a-feef051f9d50 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:42.931833 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7cc76f85-d288-4d2d-a75a-feef051f9d50 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:42.977571 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-4a7c0852-ddab-42f4-9357-5a1cc8fa1892 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:42.988082 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-4a7c0852-ddab-42f4-9357-5a1cc8fa1892 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1260 microversion: 2.1 time: 0.259828 Apr 30 13:21:42.988458 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 398/710] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:42 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1260 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:42.992910 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-faffe8b2-71b8-4bc3-b03d-9948cb23fe2e tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750022bb80>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:43.061625 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-7cc76f85-d288-4d2d-a75a-feef051f9d50 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action" status: 200 len: 14 microversion: 2.1 time: 0.145060 Apr 30 13:21:43.062561 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 313/711] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:21:42 2021] POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 30 13:21:43.087991 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-faffe8b2-71b8-4bc3-b03d-9948cb23fe2e tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.098384 Apr 30 13:21:43.088591 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 399/712] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:21:42 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:21:44.007481 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-c094ed27-d113-4bc7-b430-03cbd8920345 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:44.008189 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-c094ed27-d113-4bc7-b430-03cbd8920345 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:44.016614 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c094ed27-d113-4bc7-b430-03cbd8920345 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:44.017067 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c094ed27-d113-4bc7-b430-03cbd8920345 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:44.017854 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c094ed27-d113-4bc7-b430-03cbd8920345 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:44.018324 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c094ed27-d113-4bc7-b430-03cbd8920345 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:44.073135 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-ba63c967-fd61-464b-b38d-76e12d88757c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:21:44.073961 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-ba63c967-fd61-464b-b38d-76e12d88757c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 51ec80af-a515-409f-a251-9d0a9718889b] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:44.082946 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ba63c967-fd61-464b-b38d-76e12d88757c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:44.083414 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ba63c967-fd61-464b-b38d-76e12d88757c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:44.084209 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ba63c967-fd61-464b-b38d-76e12d88757c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:44.084658 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ba63c967-fd61-464b-b38d-76e12d88757c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:44.213567 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-ba63c967-fd61-464b-b38d-76e12d88757c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action" status: 200 len: 14 microversion: 2.1 time: 0.141457 Apr 30 13:21:44.213567 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 400/713] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:21:44 2021] POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 30 13:21:44.216825 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-509765ea-32c5-4b22-844a-1f3bfe2128da tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb7d6dc0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:44.222229 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-c094ed27-d113-4bc7-b430-03cbd8920345 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:44.230999 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-c094ed27-d113-4bc7-b430-03cbd8920345 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1260 microversion: 2.1 time: 0.227489 Apr 30 13:21:44.238297 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 314/714] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:44 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1260 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:44.312083 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-509765ea-32c5-4b22-844a-1f3bfe2128da tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.098588 Apr 30 13:21:44.312083 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 401/715] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:21:44 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:21:45.222394 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-328268b5-cc9a-4c93-a1a0-99ed47b68356 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:21:45.223318 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-328268b5-cc9a-4c93-a1a0-99ed47b68356 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 51ec80af-a515-409f-a251-9d0a9718889b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:45.231132 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-328268b5-cc9a-4c93-a1a0-99ed47b68356 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:45.231584 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-328268b5-cc9a-4c93-a1a0-99ed47b68356 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:45.232366 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-328268b5-cc9a-4c93-a1a0-99ed47b68356 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:45.232807 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-328268b5-cc9a-4c93-a1a0-99ed47b68356 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:45.247896 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-bdfe5b76-5172-4a2e-bf5b-42bff7dcc70d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:45.248659 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-bdfe5b76-5172-4a2e-bf5b-42bff7dcc70d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:45.257225 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-bdfe5b76-5172-4a2e-bf5b-42bff7dcc70d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:45.257673 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-bdfe5b76-5172-4a2e-bf5b-42bff7dcc70d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:45.258689 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-bdfe5b76-5172-4a2e-bf5b-42bff7dcc70d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:45.259313 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-bdfe5b76-5172-4a2e-bf5b-42bff7dcc70d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:45.357651 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-328268b5-cc9a-4c93-a1a0-99ed47b68356 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action" status: 200 len: 14 microversion: 2.1 time: 0.136421 Apr 30 13:21:45.357651 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 315/716] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:21:45 2021] POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 13:21:45.361958 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-d3f975b1-6659-4e42-8c21-ae49631f085e tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500bbc040>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:45.456106 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-d3f975b1-6659-4e42-8c21-ae49631f085e tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.099655 Apr 30 13:21:45.456688 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 316/717] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:21:45 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:21:45.465519 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-bdfe5b76-5172-4a2e-bf5b-42bff7dcc70d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:45.475903 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-bdfe5b76-5172-4a2e-bf5b-42bff7dcc70d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1260 microversion: 2.1 time: 0.232126 Apr 30 13:21:45.476413 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 402/718] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:45 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1260 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:21:46.366745 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-fe968d4c-286d-44c2-8e66-41f35680dcd8 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:21:46.367770 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-fe968d4c-286d-44c2-8e66-41f35680dcd8 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 51ec80af-a515-409f-a251-9d0a9718889b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:46.377279 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fe968d4c-286d-44c2-8e66-41f35680dcd8 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:46.377763 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fe968d4c-286d-44c2-8e66-41f35680dcd8 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:46.378683 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fe968d4c-286d-44c2-8e66-41f35680dcd8 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:46.379146 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fe968d4c-286d-44c2-8e66-41f35680dcd8 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:46.469592 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-2de8ba18-155e-42cd-ba78-c815c02beab3 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500130e50>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:46.508812 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-fe968d4c-286d-44c2-8e66-41f35680dcd8 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action" status: 200 len: 14 microversion: 2.1 time: 0.145965 Apr 30 13:21:46.509446 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 317/719] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:21:46 2021] POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 13:21:46.514630 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-75001c84-b49e-4661-a8a5-93f51e699764 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:46.515339 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-75001c84-b49e-4661-a8a5-93f51e699764 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:46.523462 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-75001c84-b49e-4661-a8a5-93f51e699764 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:46.523918 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-75001c84-b49e-4661-a8a5-93f51e699764 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:46.524699 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-75001c84-b49e-4661-a8a5-93f51e699764 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:46.525145 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-75001c84-b49e-4661-a8a5-93f51e699764 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:46.563754 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-2de8ba18-155e-42cd-ba78-c815c02beab3 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.098531 Apr 30 13:21:46.564371 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 403/720] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:21:46 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:21:46.728567 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-75001c84-b49e-4661-a8a5-93f51e699764 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:46.737623 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-75001c84-b49e-4661-a8a5-93f51e699764 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1260 microversion: 2.1 time: 0.226946 Apr 30 13:21:46.738281 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 318/721] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:46 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1260 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:47.520294 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-8a61f08d-ab9b-4a3d-b8ff-ca9516fe7cf7 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:21:47.521200 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-8a61f08d-ab9b-4a3d-b8ff-ca9516fe7cf7 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 51ec80af-a515-409f-a251-9d0a9718889b] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:47.529099 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8a61f08d-ab9b-4a3d-b8ff-ca9516fe7cf7 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:47.529551 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8a61f08d-ab9b-4a3d-b8ff-ca9516fe7cf7 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:47.530380 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8a61f08d-ab9b-4a3d-b8ff-ca9516fe7cf7 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:47.530819 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8a61f08d-ab9b-4a3d-b8ff-ca9516fe7cf7 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:47.575898 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-f9060a52-ac52-4966-a7e9-f21c7c8e0e68 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500bff670>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:47.652525 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-8a61f08d-ab9b-4a3d-b8ff-ca9516fe7cf7 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action" status: 200 len: 14 microversion: 2.1 time: 0.136227 Apr 30 13:21:47.653164 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 404/722] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:21:47 2021] POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 13:21:47.669668 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-f9060a52-ac52-4966-a7e9-f21c7c8e0e68 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.097507 Apr 30 13:21:47.670281 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 319/723] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:21:47 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:21:47.753984 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-299cfd70-39e3-482e-9217-dfc139bb5a76 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:47.754714 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-299cfd70-39e3-482e-9217-dfc139bb5a76 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:47.762701 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-299cfd70-39e3-482e-9217-dfc139bb5a76 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:47.763157 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-299cfd70-39e3-482e-9217-dfc139bb5a76 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:47.763941 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-299cfd70-39e3-482e-9217-dfc139bb5a76 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:47.764382 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-299cfd70-39e3-482e-9217-dfc139bb5a76 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:47.969846 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-299cfd70-39e3-482e-9217-dfc139bb5a76 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:47.978512 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-299cfd70-39e3-482e-9217-dfc139bb5a76 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1260 microversion: 2.1 time: 0.228613 Apr 30 13:21:47.979095 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 405/724] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:47 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1260 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:48.664874 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-65d45280-aa37-492f-83f5-d06580606d0c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:21:48.665939 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-65d45280-aa37-492f-83f5-d06580606d0c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 51ec80af-a515-409f-a251-9d0a9718889b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:48.675032 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-65d45280-aa37-492f-83f5-d06580606d0c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:48.675638 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-65d45280-aa37-492f-83f5-d06580606d0c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:48.676452 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-65d45280-aa37-492f-83f5-d06580606d0c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:48.677166 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-65d45280-aa37-492f-83f5-d06580606d0c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:48.682227 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-4b135119-fa64-45b5-afa4-0b9fff6d7556 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500161b80>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:48.781653 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-4b135119-fa64-45b5-afa4-0b9fff6d7556 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.103098 Apr 30 13:21:48.782407 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 406/725] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:21:48 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:21:48.802967 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-65d45280-aa37-492f-83f5-d06580606d0c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action" status: 200 len: 14 microversion: 2.1 time: 0.142491 Apr 30 13:21:48.803907 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 320/726] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:21:48 2021] POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action => generated 14 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 13:21:48.998705 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b8d1d1a4-01d4-45b6-b2db-fb10bd57468c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:49.000234 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-b8d1d1a4-01d4-45b6-b2db-fb10bd57468c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:49.013695 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b8d1d1a4-01d4-45b6-b2db-fb10bd57468c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:49.014606 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b8d1d1a4-01d4-45b6-b2db-fb10bd57468c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:49.015978 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b8d1d1a4-01d4-45b6-b2db-fb10bd57468c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:49.016732 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b8d1d1a4-01d4-45b6-b2db-fb10bd57468c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:49.276273 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-b8d1d1a4-01d4-45b6-b2db-fb10bd57468c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:49.293523 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b8d1d1a4-01d4-45b6-b2db-fb10bd57468c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1260 microversion: 2.1 time: 0.301100 Apr 30 13:21:49.294669 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 407/727] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:48 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1260 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:49.794548 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-459d65fd-c6b4-46e8-9ce2-2cab98c76dc1 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f75001613a0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:49.815863 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-c93c3da2-2498-456a-b5cc-e521ec07f258 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:21:49.816793 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-c93c3da2-2498-456a-b5cc-e521ec07f258 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 51ec80af-a515-409f-a251-9d0a9718889b] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:49.824819 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c93c3da2-2498-456a-b5cc-e521ec07f258 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:49.825277 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c93c3da2-2498-456a-b5cc-e521ec07f258 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:49.826113 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c93c3da2-2498-456a-b5cc-e521ec07f258 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:49.826550 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c93c3da2-2498-456a-b5cc-e521ec07f258 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:49.899743 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-459d65fd-c6b4-46e8-9ce2-2cab98c76dc1 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.109372 Apr 30 13:21:49.900320 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 321/728] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:21:49 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:21:49.962258 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-c93c3da2-2498-456a-b5cc-e521ec07f258 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action" status: 200 len: 6018 microversion: 2.1 time: 0.151798 Apr 30 13:21:49.962916 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 408/729] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:21:49 2021] POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action => generated 6018 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:21:50.311253 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-c9e76019-b217-434f-91e4-92b794c1b0d2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:50.312056 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-c9e76019-b217-434f-91e4-92b794c1b0d2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:50.321267 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c9e76019-b217-434f-91e4-92b794c1b0d2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:50.321793 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c9e76019-b217-434f-91e4-92b794c1b0d2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:50.322576 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c9e76019-b217-434f-91e4-92b794c1b0d2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:50.323014 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c9e76019-b217-434f-91e4-92b794c1b0d2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:50.528606 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-c9e76019-b217-434f-91e4-92b794c1b0d2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:50.538938 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-c9e76019-b217-434f-91e4-92b794c1b0d2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1260 microversion: 2.1 time: 0.231386 Apr 30 13:21:50.539801 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 322/730] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:50 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1260 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:50.913553 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-6b53a027-1a27-4b70-8b98-e3a0866f4c1f tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500130e50>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:50.973990 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-329b0697-11ba-4e1a-a7de-cf8fece40d14 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:21:50.974998 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-329b0697-11ba-4e1a-a7de-cf8fece40d14 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 51ec80af-a515-409f-a251-9d0a9718889b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:50.983132 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-329b0697-11ba-4e1a-a7de-cf8fece40d14 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:50.983673 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-329b0697-11ba-4e1a-a7de-cf8fece40d14 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:50.985423 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-329b0697-11ba-4e1a-a7de-cf8fece40d14 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:50.985896 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-329b0697-11ba-4e1a-a7de-cf8fece40d14 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:51.009824 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-6b53a027-1a27-4b70-8b98-e3a0866f4c1f tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.100635 Apr 30 13:21:51.010582 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 409/731] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:21:50 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:21:51.113602 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-329b0697-11ba-4e1a-a7de-cf8fece40d14 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action" status: 200 len: 15025 microversion: 2.1 time: 0.143515 Apr 30 13:21:51.114297 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 323/732] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:21:50 2021] POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action => generated 15025 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 13:21:51.556990 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-bba1e235-d572-4ca3-85fe-4b7bd09bc66e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:51.557638 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-bba1e235-d572-4ca3-85fe-4b7bd09bc66e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:51.566575 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-bba1e235-d572-4ca3-85fe-4b7bd09bc66e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:51.567028 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-bba1e235-d572-4ca3-85fe-4b7bd09bc66e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:51.567822 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-bba1e235-d572-4ca3-85fe-4b7bd09bc66e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:51.568262 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-bba1e235-d572-4ca3-85fe-4b7bd09bc66e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:51.781488 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-bba1e235-d572-4ca3-85fe-4b7bd09bc66e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:51.790924 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-bba1e235-d572-4ca3-85fe-4b7bd09bc66e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1260 microversion: 2.1 time: 0.237665 Apr 30 13:21:51.791648 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 410/733] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:51 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1260 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:52.023015 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-a29c2c8e-c0a1-4b86-bf08-fa447faf991d tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750024f790>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:52.115851 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-a29c2c8e-c0a1-4b86-bf08-fa447faf991d tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.096944 Apr 30 13:21:52.116567 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 324/734] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:21:52 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:21:52.125433 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-824daf4e-5ff8-4813-9214-85c9c0bbb98c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:21:52.126317 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-824daf4e-5ff8-4813-9214-85c9c0bbb98c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 51ec80af-a515-409f-a251-9d0a9718889b] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:52.134113 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-824daf4e-5ff8-4813-9214-85c9c0bbb98c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:52.134574 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-824daf4e-5ff8-4813-9214-85c9c0bbb98c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:52.135356 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-824daf4e-5ff8-4813-9214-85c9c0bbb98c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:52.135795 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-824daf4e-5ff8-4813-9214-85c9c0bbb98c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:52.264176 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-824daf4e-5ff8-4813-9214-85c9c0bbb98c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action" status: 200 len: 18608 microversion: 2.1 time: 0.143002 Apr 30 13:21:52.265038 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 411/735] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:21:52 2021] POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action => generated 18608 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:21:52.808882 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-15772f81-dbb6-4e1b-aa04-09fef0333cd1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:52.809616 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-15772f81-dbb6-4e1b-aa04-09fef0333cd1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:52.817958 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-15772f81-dbb6-4e1b-aa04-09fef0333cd1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:52.818439 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-15772f81-dbb6-4e1b-aa04-09fef0333cd1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:52.819219 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-15772f81-dbb6-4e1b-aa04-09fef0333cd1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:52.819657 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-15772f81-dbb6-4e1b-aa04-09fef0333cd1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:53.022701 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-15772f81-dbb6-4e1b-aa04-09fef0333cd1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:53.031080 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-15772f81-dbb6-4e1b-aa04-09fef0333cd1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1260 microversion: 2.1 time: 0.226021 Apr 30 13:21:53.031743 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 325/736] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:52 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1260 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:53.130078 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-72f2eb81-c4fd-451d-bede-53eacf3f6d87 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb7d69d0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:53.221344 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-72f2eb81-c4fd-451d-bede-53eacf3f6d87 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.096145 Apr 30 13:21:53.221914 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 412/737] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:21:53 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:21:53.276431 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-5e6b63e3-6e08-44f1-91f7-760988ec2022 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:21:53.277380 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-5e6b63e3-6e08-44f1-91f7-760988ec2022 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 51ec80af-a515-409f-a251-9d0a9718889b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:53.285215 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5e6b63e3-6e08-44f1-91f7-760988ec2022 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:53.285913 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5e6b63e3-6e08-44f1-91f7-760988ec2022 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:53.286733 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5e6b63e3-6e08-44f1-91f7-760988ec2022 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:53.287169 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5e6b63e3-6e08-44f1-91f7-760988ec2022 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:53.568300 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-5e6b63e3-6e08-44f1-91f7-760988ec2022 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action" status: 200 len: 20593 microversion: 2.1 time: 0.295517 Apr 30 13:21:53.569150 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 326/738] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:21:53 2021] POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action => generated 20593 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:21:54.047987 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-e2014583-bf7a-4ba4-bc24-40158a22453d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:54.048721 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-e2014583-bf7a-4ba4-bc24-40158a22453d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:54.056880 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e2014583-bf7a-4ba4-bc24-40158a22453d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:54.057328 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e2014583-bf7a-4ba4-bc24-40158a22453d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:54.058143 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e2014583-bf7a-4ba4-bc24-40158a22453d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:54.058584 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e2014583-bf7a-4ba4-bc24-40158a22453d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:54.235452 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-ca1a7d9e-031c-4b1e-bfcd-a0c6ae014304 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750024fca0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:54.257366 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-e2014583-bf7a-4ba4-bc24-40158a22453d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:54.266889 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-e2014583-bf7a-4ba4-bc24-40158a22453d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1260 microversion: 2.1 time: 0.222626 Apr 30 13:21:54.267457 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 413/739] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:54 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1260 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:54.331574 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-ca1a7d9e-031c-4b1e-bfcd-a0c6ae014304 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.100410 Apr 30 13:21:54.332143 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 327/740] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:21:54 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:21:54.581206 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-85e34efe-8847-4e0b-81d7-416c08bfe9ad tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:21:54.582533 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-85e34efe-8847-4e0b-81d7-416c08bfe9ad tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 51ec80af-a515-409f-a251-9d0a9718889b] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:54.590057 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-85e34efe-8847-4e0b-81d7-416c08bfe9ad tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:54.590520 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-85e34efe-8847-4e0b-81d7-416c08bfe9ad tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:54.591314 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-85e34efe-8847-4e0b-81d7-416c08bfe9ad tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:54.591759 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-85e34efe-8847-4e0b-81d7-416c08bfe9ad tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:54.730743 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-85e34efe-8847-4e0b-81d7-416c08bfe9ad tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action" status: 200 len: 22860 microversion: 2.1 time: 0.154598 Apr 30 13:21:54.731565 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 414/741] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:21:54 2021] POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action => generated 22860 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:21:55.284009 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-44ebc7cf-a9c3-46a1-a7e1-9361c161aa42 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:55.284772 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-44ebc7cf-a9c3-46a1-a7e1-9361c161aa42 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:55.293498 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-44ebc7cf-a9c3-46a1-a7e1-9361c161aa42 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:55.293946 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-44ebc7cf-a9c3-46a1-a7e1-9361c161aa42 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:55.294804 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-44ebc7cf-a9c3-46a1-a7e1-9361c161aa42 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:55.295224 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-44ebc7cf-a9c3-46a1-a7e1-9361c161aa42 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:55.345095 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-fecce202-025b-4652-83f7-c9324b6e3dde tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb7d6790>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:55.437291 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-fecce202-025b-4652-83f7-c9324b6e3dde tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.096634 Apr 30 13:21:55.438323 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 415/742] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:21:55 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:21:55.498163 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-44ebc7cf-a9c3-46a1-a7e1-9361c161aa42 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:55.507576 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-44ebc7cf-a9c3-46a1-a7e1-9361c161aa42 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1260 microversion: 2.1 time: 0.227957 Apr 30 13:21:55.508244 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 328/743] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:55 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1260 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:55.742878 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-fd8fa011-69b0-42f1-96f4-374c0ed422d1 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:21:55.743987 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-fd8fa011-69b0-42f1-96f4-374c0ed422d1 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 51ec80af-a515-409f-a251-9d0a9718889b] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:55.904604 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-fd8fa011-69b0-42f1-96f4-374c0ed422d1 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:55.904970 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-fd8fa011-69b0-42f1-96f4-374c0ed422d1 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:55.905792 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-fd8fa011-69b0-42f1-96f4-374c0ed422d1 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:55.906461 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-fd8fa011-69b0-42f1-96f4-374c0ed422d1 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:56.042176 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-fd8fa011-69b0-42f1-96f4-374c0ed422d1 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action" status: 200 len: 24446 microversion: 2.1 time: 0.302284 Apr 30 13:21:56.043389 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 416/744] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:21:55 2021] POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action => generated 24446 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:21:56.449922 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-6dfb0d13-22d6-48d2-93c7-d2b5437769e2 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500bff310>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:56.525785 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b65aa2e6-79ba-4c27-8df1-287731904b01 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:56.526534 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-b65aa2e6-79ba-4c27-8df1-287731904b01 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:56.536289 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b65aa2e6-79ba-4c27-8df1-287731904b01 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:56.536764 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b65aa2e6-79ba-4c27-8df1-287731904b01 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:56.537546 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b65aa2e6-79ba-4c27-8df1-287731904b01 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:56.538056 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b65aa2e6-79ba-4c27-8df1-287731904b01 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:56.541366 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-6dfb0d13-22d6-48d2-93c7-d2b5437769e2 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.095483 Apr 30 13:21:56.541942 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 329/745] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:21:56 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:21:56.740160 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-b65aa2e6-79ba-4c27-8df1-287731904b01 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:56.748712 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b65aa2e6-79ba-4c27-8df1-287731904b01 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1260 microversion: 2.1 time: 0.227143 Apr 30 13:21:56.750197 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 417/746] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:56 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1260 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:21:57.054778 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-44f87d35-24ad-4e36-a94f-0e884b988ea8 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:21:57.055618 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-44f87d35-24ad-4e36-a94f-0e884b988ea8 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 51ec80af-a515-409f-a251-9d0a9718889b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:57.064465 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-44f87d35-24ad-4e36-a94f-0e884b988ea8 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:57.064916 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-44f87d35-24ad-4e36-a94f-0e884b988ea8 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:57.065742 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-44f87d35-24ad-4e36-a94f-0e884b988ea8 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:57.066220 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-44f87d35-24ad-4e36-a94f-0e884b988ea8 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:57.201287 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-44f87d35-24ad-4e36-a94f-0e884b988ea8 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action" status: 200 len: 26106 microversion: 2.1 time: 0.150072 Apr 30 13:21:57.201919 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 330/747] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:21:57 2021] POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action => generated 26106 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:21:57.553743 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-5c6f3714-ce67-40af-ada6-b3a98b856077 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750155edc0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:57.647050 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-5c6f3714-ce67-40af-ada6-b3a98b856077 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.096934 Apr 30 13:21:57.647732 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 418/748] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:21:57 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:21:57.768357 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-6b8937ef-0a35-4b8f-a8af-c15d356541c3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:57.769050 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-6b8937ef-0a35-4b8f-a8af-c15d356541c3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:57.777102 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6b8937ef-0a35-4b8f-a8af-c15d356541c3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:57.777559 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6b8937ef-0a35-4b8f-a8af-c15d356541c3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:57.778374 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6b8937ef-0a35-4b8f-a8af-c15d356541c3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:57.778816 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6b8937ef-0a35-4b8f-a8af-c15d356541c3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:57.979033 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-6b8937ef-0a35-4b8f-a8af-c15d356541c3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:57.987361 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-6b8937ef-0a35-4b8f-a8af-c15d356541c3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1260 microversion: 2.1 time: 0.223710 Apr 30 13:21:57.987924 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 331/749] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:57 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1260 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:58.212771 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-8b100c7b-c885-495b-ad39-31eb4b97bd33 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:21:58.213706 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-8b100c7b-c885-495b-ad39-31eb4b97bd33 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 51ec80af-a515-409f-a251-9d0a9718889b] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:58.221851 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8b100c7b-c885-495b-ad39-31eb4b97bd33 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:58.222338 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8b100c7b-c885-495b-ad39-31eb4b97bd33 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:58.223126 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8b100c7b-c885-495b-ad39-31eb4b97bd33 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:58.223573 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8b100c7b-c885-495b-ad39-31eb4b97bd33 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:58.365525 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-8b100c7b-c885-495b-ad39-31eb4b97bd33 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action" status: 200 len: 27343 microversion: 2.1 time: 0.156286 Apr 30 13:21:58.366176 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 419/750] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:21:58 2021] POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action => generated 27343 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:21:58.659949 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-86f3a659-c155-401a-a582-e52f903eb4bc tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500161ca0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:58.751837 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-86f3a659-c155-401a-a582-e52f903eb4bc tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.095656 Apr 30 13:21:58.752410 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 332/751] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:21:58 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:21:59.004190 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-cb4de33f-2524-45e0-93d2-596da53c59e2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:59.004934 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-cb4de33f-2524-45e0-93d2-596da53c59e2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:59.016319 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-cb4de33f-2524-45e0-93d2-596da53c59e2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:59.016776 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-cb4de33f-2524-45e0-93d2-596da53c59e2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:59.017606 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-cb4de33f-2524-45e0-93d2-596da53c59e2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:59.018171 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-cb4de33f-2524-45e0-93d2-596da53c59e2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:59.215997 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-cb4de33f-2524-45e0-93d2-596da53c59e2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:21:59.224779 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-cb4de33f-2524-45e0-93d2-596da53c59e2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1260 microversion: 2.1 time: 0.224860 Apr 30 13:21:59.225347 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 420/752] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:21:58 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1260 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:21:59.377397 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-d0ab1336-59cb-4840-b78b-28298a9f1214 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:21:59.378354 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-d0ab1336-59cb-4840-b78b-28298a9f1214 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 51ec80af-a515-409f-a251-9d0a9718889b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:21:59.386619 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d0ab1336-59cb-4840-b78b-28298a9f1214 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:59.387066 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d0ab1336-59cb-4840-b78b-28298a9f1214 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:59.387845 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d0ab1336-59cb-4840-b78b-28298a9f1214 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:21:59.388285 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d0ab1336-59cb-4840-b78b-28298a9f1214 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:21:59.516776 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-d0ab1336-59cb-4840-b78b-28298a9f1214 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action" status: 200 len: 27952 microversion: 2.1 time: 0.143468 Apr 30 13:21:59.517330 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 333/753] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:21:59 2021] POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action => generated 27952 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:21:59.764174 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-23e11ec4-5a00-4e91-9398-677f53cb8ffe tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb7d1040>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:21:59.858095 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-23e11ec4-5a00-4e91-9398-677f53cb8ffe tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.097538 Apr 30 13:21:59.859181 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 421/754] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:21:59 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:22:00.241895 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-14dd71e6-ef4c-414a-bd2e-2eed5e45c5bf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:00.242635 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-14dd71e6-ef4c-414a-bd2e-2eed5e45c5bf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:22:00.250728 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-14dd71e6-ef4c-414a-bd2e-2eed5e45c5bf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:00.251181 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-14dd71e6-ef4c-414a-bd2e-2eed5e45c5bf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:00.251964 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-14dd71e6-ef4c-414a-bd2e-2eed5e45c5bf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:00.252405 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-14dd71e6-ef4c-414a-bd2e-2eed5e45c5bf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:00.528872 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-6b204d8c-ab8f-432a-8090-c7dffee2ecb2 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:22:00.529937 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-6b204d8c-ab8f-432a-8090-c7dffee2ecb2 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 51ec80af-a515-409f-a251-9d0a9718889b] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:22:00.538418 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6b204d8c-ab8f-432a-8090-c7dffee2ecb2 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:00.538879 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6b204d8c-ab8f-432a-8090-c7dffee2ecb2 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:00.539704 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6b204d8c-ab8f-432a-8090-c7dffee2ecb2 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:00.540144 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6b204d8c-ab8f-432a-8090-c7dffee2ecb2 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:00.549560 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-14dd71e6-ef4c-414a-bd2e-2eed5e45c5bf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:22:00.558000 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-14dd71e6-ef4c-414a-bd2e-2eed5e45c5bf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1260 microversion: 2.1 time: 0.320230 Apr 30 13:22:00.558719 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 334/755] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:22:00 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1260 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:22:00.672547 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-6b204d8c-ab8f-432a-8090-c7dffee2ecb2 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action" status: 200 len: 28247 microversion: 2.1 time: 0.147590 Apr 30 13:22:00.673441 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 422/756] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:22:00 2021] POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action => generated 28247 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 13:22:00.871280 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-9a44219c-c481-4c1a-8922-d3778ae97c6a tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f75014d1820>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:00.962364 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-9a44219c-c481-4c1a-8922-d3778ae97c6a tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.094751 Apr 30 13:22:00.962940 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 335/757] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:00 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:22:01.576811 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-c2a46f07-3fe6-4877-8c41-6d8137752d94 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:01.577445 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-c2a46f07-3fe6-4877-8c41-6d8137752d94 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:22:01.585520 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c2a46f07-3fe6-4877-8c41-6d8137752d94 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:01.585981 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c2a46f07-3fe6-4877-8c41-6d8137752d94 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:01.586802 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c2a46f07-3fe6-4877-8c41-6d8137752d94 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:01.587249 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c2a46f07-3fe6-4877-8c41-6d8137752d94 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:01.684924 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-a67e9c4e-ba1a-4652-9772-a8af6f0bf67c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:22:01.685832 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-a67e9c4e-ba1a-4652-9772-a8af6f0bf67c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 51ec80af-a515-409f-a251-9d0a9718889b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:22:01.694224 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a67e9c4e-ba1a-4652-9772-a8af6f0bf67c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:01.694681 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a67e9c4e-ba1a-4652-9772-a8af6f0bf67c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:01.695462 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a67e9c4e-ba1a-4652-9772-a8af6f0bf67c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:01.695899 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a67e9c4e-ba1a-4652-9772-a8af6f0bf67c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:01.795226 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-c2a46f07-3fe6-4877-8c41-6d8137752d94 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:22:01.804077 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-c2a46f07-3fe6-4877-8c41-6d8137752d94 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1260 microversion: 2.1 time: 0.231501 Apr 30 13:22:01.804661 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 423/758] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:22:01 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1260 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:22:01.822958 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-a67e9c4e-ba1a-4652-9772-a8af6f0bf67c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action" status: 200 len: 28247 microversion: 2.1 time: 0.142176 Apr 30 13:22:01.823598 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 336/759] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:22:01 2021] POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action => generated 28247 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 13:22:01.975657 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-07f87111-a892-4a48-b50e-e6767bb1de14 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500c6f670>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:02.068815 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-07f87111-a892-4a48-b50e-e6767bb1de14 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.096744 Apr 30 13:22:02.069402 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 424/760] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:01 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:22:02.821864 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-f37fe9ab-35c8-4893-b4e8-3fd3d17ad591 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:02.822426 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-f37fe9ab-35c8-4893-b4e8-3fd3d17ad591 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:22:02.831464 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f37fe9ab-35c8-4893-b4e8-3fd3d17ad591 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:02.831925 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f37fe9ab-35c8-4893-b4e8-3fd3d17ad591 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:02.832726 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f37fe9ab-35c8-4893-b4e8-3fd3d17ad591 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:02.833174 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f37fe9ab-35c8-4893-b4e8-3fd3d17ad591 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:02.835662 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-43eea5e6-d7a3-4a07-b7a2-df3165b6bc2d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:22:02.836765 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-43eea5e6-d7a3-4a07-b7a2-df3165b6bc2d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 51ec80af-a515-409f-a251-9d0a9718889b] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:22:02.846252 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-43eea5e6-d7a3-4a07-b7a2-df3165b6bc2d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:02.846903 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-43eea5e6-d7a3-4a07-b7a2-df3165b6bc2d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:02.847704 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-43eea5e6-d7a3-4a07-b7a2-df3165b6bc2d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:02.848147 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-43eea5e6-d7a3-4a07-b7a2-df3165b6bc2d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:02.992647 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-43eea5e6-d7a3-4a07-b7a2-df3165b6bc2d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action" status: 200 len: 28538 microversion: 2.1 time: 0.161452 Apr 30 13:22:02.993297 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 425/761] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:22:02 2021] POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action => generated 28538 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 13:22:03.054791 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-f37fe9ab-35c8-4893-b4e8-3fd3d17ad591 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:22:03.063123 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-f37fe9ab-35c8-4893-b4e8-3fd3d17ad591 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1260 microversion: 2.1 time: 0.245638 Apr 30 13:22:03.063733 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 337/762] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:22:02 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1260 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:22:03.081634 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-7baf74fe-8892-4907-8c82-dcd704eca7a1 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500130f70>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:03.176889 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-7baf74fe-8892-4907-8c82-dcd704eca7a1 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.099909 Apr 30 13:22:03.177537 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 426/763] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:03 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:22:04.003908 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-4a3ed70b-2941-4011-ac35-7eb74fbd2810 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:22:04.004833 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-4a3ed70b-2941-4011-ac35-7eb74fbd2810 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 51ec80af-a515-409f-a251-9d0a9718889b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:22:04.012642 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4a3ed70b-2941-4011-ac35-7eb74fbd2810 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:04.013094 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4a3ed70b-2941-4011-ac35-7eb74fbd2810 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:04.013884 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4a3ed70b-2941-4011-ac35-7eb74fbd2810 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:04.014362 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4a3ed70b-2941-4011-ac35-7eb74fbd2810 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:04.080218 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-9c6ad5c6-ad82-4c5f-ad9a-bbc44b5fde53 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:04.080960 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-9c6ad5c6-ad82-4c5f-ad9a-bbc44b5fde53 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:22:04.089172 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9c6ad5c6-ad82-4c5f-ad9a-bbc44b5fde53 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:04.089631 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9c6ad5c6-ad82-4c5f-ad9a-bbc44b5fde53 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:04.090456 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9c6ad5c6-ad82-4c5f-ad9a-bbc44b5fde53 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:04.090902 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9c6ad5c6-ad82-4c5f-ad9a-bbc44b5fde53 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:04.155217 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-4a3ed70b-2941-4011-ac35-7eb74fbd2810 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action" status: 200 len: 28706 microversion: 2.1 time: 0.154880 Apr 30 13:22:04.156812 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 338/764] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:22:03 2021] POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action => generated 28706 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:22:04.189606 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-4399203e-910f-4db1-a8ab-0dcc4bc4ffb4 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500161e50>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:04.283763 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-4399203e-910f-4db1-a8ab-0dcc4bc4ffb4 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.098684 Apr 30 13:22:04.284337 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 339/765] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:04 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:22:04.298849 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-9c6ad5c6-ad82-4c5f-ad9a-bbc44b5fde53 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:22:04.307111 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-9c6ad5c6-ad82-4c5f-ad9a-bbc44b5fde53 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1260 microversion: 2.1 time: 0.230902 Apr 30 13:22:04.307672 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 427/766] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:22:04 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1260 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:22:05.168085 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-2edd0650-8307-4067-bb61-cf1a661c37b1 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:22:05.169211 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-2edd0650-8307-4067-bb61-cf1a661c37b1 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 51ec80af-a515-409f-a251-9d0a9718889b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:22:05.178489 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2edd0650-8307-4067-bb61-cf1a661c37b1 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:05.178954 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2edd0650-8307-4067-bb61-cf1a661c37b1 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:05.179879 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2edd0650-8307-4067-bb61-cf1a661c37b1 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:05.180393 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2edd0650-8307-4067-bb61-cf1a661c37b1 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:05.300287 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-06a4acfb-259e-475a-95e3-1dae907c75ec tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750022bb80>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:05.303028 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-2edd0650-8307-4067-bb61-cf1a661c37b1 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action" status: 200 len: 28706 microversion: 2.1 time: 0.138815 Apr 30 13:22:05.307066 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 340/767] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:22:05 2021] POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action => generated 28706 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:22:05.323501 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-f6c95a34-314c-4f2c-b15a-33d4857446a0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:05.324201 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-f6c95a34-314c-4f2c-b15a-33d4857446a0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:22:05.332741 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f6c95a34-314c-4f2c-b15a-33d4857446a0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:05.333194 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f6c95a34-314c-4f2c-b15a-33d4857446a0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:05.334030 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f6c95a34-314c-4f2c-b15a-33d4857446a0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:05.334485 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f6c95a34-314c-4f2c-b15a-33d4857446a0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:05.393905 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-06a4acfb-259e-475a-95e3-1dae907c75ec tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.097876 Apr 30 13:22:05.394635 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 428/768] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:05 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:22:05.535238 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-f6c95a34-314c-4f2c-b15a-33d4857446a0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:22:05.543702 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-f6c95a34-314c-4f2c-b15a-33d4857446a0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1260 microversion: 2.1 time: 0.224467 Apr 30 13:22:05.544256 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 341/769] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:22:05 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1260 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:22:06.316012 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-ab2e8807-4a30-4205-8950-4a663e616586 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:22:06.316965 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-ab2e8807-4a30-4205-8950-4a663e616586 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 51ec80af-a515-409f-a251-9d0a9718889b] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:22:06.324996 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ab2e8807-4a30-4205-8950-4a663e616586 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:06.325455 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ab2e8807-4a30-4205-8950-4a663e616586 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:06.326273 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ab2e8807-4a30-4205-8950-4a663e616586 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:06.326717 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ab2e8807-4a30-4205-8950-4a663e616586 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:06.406939 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-c6f2e2fb-60e5-430d-bd8a-d399284afe6e tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500bff790>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:06.449476 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-ab2e8807-4a30-4205-8950-4a663e616586 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action" status: 200 len: 28706 microversion: 2.1 time: 0.138208 Apr 30 13:22:06.450165 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 429/770] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:22:06 2021] POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action => generated 28706 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:22:06.502431 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-c6f2e2fb-60e5-430d-bd8a-d399284afe6e tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.099204 Apr 30 13:22:06.503105 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 342/771] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:06 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:22:06.562279 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-80135dce-1b24-4216-896e-b68a4b6953bc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:06.563143 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-80135dce-1b24-4216-896e-b68a4b6953bc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:22:06.571158 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-80135dce-1b24-4216-896e-b68a4b6953bc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:06.571614 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-80135dce-1b24-4216-896e-b68a4b6953bc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:06.572425 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-80135dce-1b24-4216-896e-b68a4b6953bc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:06.572864 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-80135dce-1b24-4216-896e-b68a4b6953bc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:06.773144 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-80135dce-1b24-4216-896e-b68a4b6953bc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:22:06.782044 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-80135dce-1b24-4216-896e-b68a4b6953bc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1260 microversion: 2.1 time: 0.224665 Apr 30 13:22:06.782609 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 430/772] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:22:06 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1260 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:22:07.461446 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-c8316e7a-ae3e-4c0a-aead-5270ba560029 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:22:07.462406 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-c8316e7a-ae3e-4c0a-aead-5270ba560029 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 51ec80af-a515-409f-a251-9d0a9718889b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:22:07.470655 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c8316e7a-ae3e-4c0a-aead-5270ba560029 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:07.471114 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c8316e7a-ae3e-4c0a-aead-5270ba560029 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:07.471906 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c8316e7a-ae3e-4c0a-aead-5270ba560029 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:07.472349 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c8316e7a-ae3e-4c0a-aead-5270ba560029 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:07.515618 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-02752b1c-7aec-4fd6-90b0-fda62a323c23 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500130dc0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:07.603293 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-c8316e7a-ae3e-4c0a-aead-5270ba560029 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action" status: 200 len: 29230 microversion: 2.1 time: 0.145416 Apr 30 13:22:07.604001 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 343/773] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:22:07 2021] POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action => generated 29230 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:22:07.606326 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-02752b1c-7aec-4fd6-90b0-fda62a323c23 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.095031 Apr 30 13:22:07.606897 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 431/774] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:07 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:22:07.799935 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-30eb7d39-8cff-44e9-9d4d-0de9bf25e31b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:07.800678 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-30eb7d39-8cff-44e9-9d4d-0de9bf25e31b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:22:07.809441 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-30eb7d39-8cff-44e9-9d4d-0de9bf25e31b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:07.809896 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-30eb7d39-8cff-44e9-9d4d-0de9bf25e31b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:07.810718 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-30eb7d39-8cff-44e9-9d4d-0de9bf25e31b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:07.811163 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-30eb7d39-8cff-44e9-9d4d-0de9bf25e31b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:08.018884 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-30eb7d39-8cff-44e9-9d4d-0de9bf25e31b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:22:08.027154 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-30eb7d39-8cff-44e9-9d4d-0de9bf25e31b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1260 microversion: 2.1 time: 0.231818 Apr 30 13:22:08.027710 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 344/775] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:22:07 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1260 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:22:08.616182 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-c31e7d16-d667-4b1c-b318-cd2374ffaf81 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:22:08.617034 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-c31e7d16-d667-4b1c-b318-cd2374ffaf81 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 51ec80af-a515-409f-a251-9d0a9718889b] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:22:08.618278 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-87085683-1a2f-45d5-b25f-dbc41c2c9b41 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fbfc9670>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:08.626141 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c31e7d16-d667-4b1c-b318-cd2374ffaf81 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:08.626741 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c31e7d16-d667-4b1c-b318-cd2374ffaf81 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:08.627696 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c31e7d16-d667-4b1c-b318-cd2374ffaf81 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:08.628370 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c31e7d16-d667-4b1c-b318-cd2374ffaf81 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:08.721353 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-87085683-1a2f-45d5-b25f-dbc41c2c9b41 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.106787 Apr 30 13:22:08.721928 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 345/776] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:08 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:22:08.766543 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-c31e7d16-d667-4b1c-b318-cd2374ffaf81 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action" status: 200 len: 31535 microversion: 2.1 time: 0.154130 Apr 30 13:22:08.767417 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 432/777] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:22:08 2021] POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action => generated 31535 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:22:09.044491 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-0da30d11-fb78-4de1-90c5-b5dbb2974284 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:09.045109 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-0da30d11-fb78-4de1-90c5-b5dbb2974284 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:22:09.053664 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0da30d11-fb78-4de1-90c5-b5dbb2974284 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:09.054148 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0da30d11-fb78-4de1-90c5-b5dbb2974284 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:09.054937 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0da30d11-fb78-4de1-90c5-b5dbb2974284 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:09.055381 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0da30d11-fb78-4de1-90c5-b5dbb2974284 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:09.248607 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-0da30d11-fb78-4de1-90c5-b5dbb2974284 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:22:09.257109 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-0da30d11-fb78-4de1-90c5-b5dbb2974284 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1260 microversion: 2.1 time: 0.216840 Apr 30 13:22:09.257710 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 346/778] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:22:09 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1260 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:22:09.734419 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-3297acc7-0c68-430a-bc11-2ed656b72de1 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500130d30>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:09.778414 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-b1f26083-45b6-4dfc-89e6-6ae7b62118d7 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:22:09.779364 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-b1f26083-45b6-4dfc-89e6-6ae7b62118d7 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 51ec80af-a515-409f-a251-9d0a9718889b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:22:09.787280 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b1f26083-45b6-4dfc-89e6-6ae7b62118d7 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:09.787753 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b1f26083-45b6-4dfc-89e6-6ae7b62118d7 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:09.788548 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b1f26083-45b6-4dfc-89e6-6ae7b62118d7 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:09.789050 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b1f26083-45b6-4dfc-89e6-6ae7b62118d7 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:09.834363 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-3297acc7-0c68-430a-bc11-2ed656b72de1 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.104063 Apr 30 13:22:09.835164 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 433/779] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:09 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:22:09.925517 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-b1f26083-45b6-4dfc-89e6-6ae7b62118d7 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action" status: 200 len: 33033 microversion: 2.1 time: 0.150764 Apr 30 13:22:09.926214 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 347/780] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:22:09 2021] POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action => generated 33033 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 13:22:10.274705 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-680f788a-eaf8-4022-8676-4ea8eab10894 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:10.275344 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-680f788a-eaf8-4022-8676-4ea8eab10894 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:22:10.283836 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-680f788a-eaf8-4022-8676-4ea8eab10894 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:10.284292 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-680f788a-eaf8-4022-8676-4ea8eab10894 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:10.285072 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-680f788a-eaf8-4022-8676-4ea8eab10894 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:10.285515 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-680f788a-eaf8-4022-8676-4ea8eab10894 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:10.488016 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-680f788a-eaf8-4022-8676-4ea8eab10894 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:22:10.496317 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-680f788a-eaf8-4022-8676-4ea8eab10894 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1260 microversion: 2.1 time: 0.225503 Apr 30 13:22:10.497038 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 434/781] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:22:10 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1260 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:22:10.847246 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-2a8ee6d7-bcb2-49e3-be59-6c9642fdd59d tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f75001619d0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:10.938793 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-0d4b215e-acc6-4f86-b64d-468576b90646 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:22:10.938793 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-0d4b215e-acc6-4f86-b64d-468576b90646 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 51ec80af-a515-409f-a251-9d0a9718889b] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:22:10.940137 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-2a8ee6d7-bcb2-49e3-be59-6c9642fdd59d tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.097300 Apr 30 13:22:10.940699 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 348/782] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:10 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:22:10.946804 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0d4b215e-acc6-4f86-b64d-468576b90646 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:10.947265 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0d4b215e-acc6-4f86-b64d-468576b90646 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:10.948055 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0d4b215e-acc6-4f86-b64d-468576b90646 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:10.948498 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0d4b215e-acc6-4f86-b64d-468576b90646 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:11.080222 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-0d4b215e-acc6-4f86-b64d-468576b90646 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action" status: 200 len: 33972 microversion: 2.1 time: 0.146553 Apr 30 13:22:11.080859 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 435/783] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:22:10 2021] POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action => generated 33972 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 13:22:11.513741 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-593d72f7-9414-46b1-b061-b28afadae4c7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:11.515193 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-593d72f7-9414-46b1-b061-b28afadae4c7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:22:11.523401 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-593d72f7-9414-46b1-b061-b28afadae4c7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:11.523862 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-593d72f7-9414-46b1-b061-b28afadae4c7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:11.524645 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-593d72f7-9414-46b1-b061-b28afadae4c7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:11.525082 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-593d72f7-9414-46b1-b061-b28afadae4c7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:11.723836 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-593d72f7-9414-46b1-b061-b28afadae4c7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:22:11.732715 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-593d72f7-9414-46b1-b061-b28afadae4c7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1260 microversion: 2.1 time: 0.223221 Apr 30 13:22:11.733459 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 349/784] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:22:11 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1260 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:22:11.953968 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-81fda7ec-f6c5-4b9a-b3e3-5786e579614d tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f75003575e0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:12.045038 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-81fda7ec-f6c5-4b9a-b3e3-5786e579614d tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.095828 Apr 30 13:22:12.045608 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 436/785] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:11 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:22:12.092329 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-9fae1d49-1c31-4665-bcd1-1f1826a11fe8 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:22:12.093474 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-9fae1d49-1c31-4665-bcd1-1f1826a11fe8 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 51ec80af-a515-409f-a251-9d0a9718889b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:22:12.101383 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9fae1d49-1c31-4665-bcd1-1f1826a11fe8 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:12.101846 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9fae1d49-1c31-4665-bcd1-1f1826a11fe8 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:12.102683 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9fae1d49-1c31-4665-bcd1-1f1826a11fe8 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:12.103151 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9fae1d49-1c31-4665-bcd1-1f1826a11fe8 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:12.749560 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-98d3a610-4e07-48ef-8b91-dd04dd6746a6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:12.750203 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-98d3a610-4e07-48ef-8b91-dd04dd6746a6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:22:12.758326 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-98d3a610-4e07-48ef-8b91-dd04dd6746a6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:12.758773 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-98d3a610-4e07-48ef-8b91-dd04dd6746a6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:12.759540 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-98d3a610-4e07-48ef-8b91-dd04dd6746a6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:12.759972 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-98d3a610-4e07-48ef-8b91-dd04dd6746a6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:12.958352 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-98d3a610-4e07-48ef-8b91-dd04dd6746a6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:22:12.967131 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-98d3a610-4e07-48ef-8b91-dd04dd6746a6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1260 microversion: 2.1 time: 0.222037 Apr 30 13:22:12.968221 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 437/786] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:22:12 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1260 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:22:13.056744 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-e041a1e7-66f7-4fda-8f22-867fbc66b420 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500130d30>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:13.146972 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-e041a1e7-66f7-4fda-8f22-867fbc66b420 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.093942 Apr 30 13:22:13.147658 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 438/787] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:13 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:22:13.987680 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-50ecd454-5196-4c44-b13e-42dbebe33478 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:13.988417 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-50ecd454-5196-4c44-b13e-42dbebe33478 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:22:13.996043 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-50ecd454-5196-4c44-b13e-42dbebe33478 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:13.996503 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-50ecd454-5196-4c44-b13e-42dbebe33478 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:13.997292 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-50ecd454-5196-4c44-b13e-42dbebe33478 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:13.997734 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-50ecd454-5196-4c44-b13e-42dbebe33478 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:14.198363 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-50ecd454-5196-4c44-b13e-42dbebe33478 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:22:14.207157 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-50ecd454-5196-4c44-b13e-42dbebe33478 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1260 microversion: 2.1 time: 0.224793 Apr 30 13:22:14.207727 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 439/788] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:22:13 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1260 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:22:14.214901 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-eba82c45-e3c5-4eeb-9bb4-2e6ccbcad156 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb7d13a0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:14.309474 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-eba82c45-e3c5-4eeb-9bb4-2e6ccbcad156 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.100687 Apr 30 13:22:14.310072 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 440/789] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:14 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:22:14.738956 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-9fae1d49-1c31-4665-bcd1-1f1826a11fe8 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action" status: 200 len: 38221 microversion: 2.1 time: 2.650155 Apr 30 13:22:14.739941 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 350/790] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:22:12 2021] POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action => generated 38221 bytes in 2652 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:22:15.225030 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-dbc1ea0e-718d-426d-9b11-7f45764314b0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:15.226896 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-dbc1ea0e-718d-426d-9b11-7f45764314b0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:22:15.233729 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-dbc1ea0e-718d-426d-9b11-7f45764314b0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:15.234309 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-dbc1ea0e-718d-426d-9b11-7f45764314b0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:15.234986 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-dbc1ea0e-718d-426d-9b11-7f45764314b0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:15.235431 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-dbc1ea0e-718d-426d-9b11-7f45764314b0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:15.322877 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-c1c322e0-00c1-45d1-b4ee-db3e54950e91 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500bbcb80>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:15.418025 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-c1c322e0-00c1-45d1-b4ee-db3e54950e91 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.099151 Apr 30 13:22:15.418591 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 351/791] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:15 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:22:15.501454 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-dbc1ea0e-718d-426d-9b11-7f45764314b0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:22:15.510066 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-dbc1ea0e-718d-426d-9b11-7f45764314b0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1260 microversion: 2.1 time: 0.289235 Apr 30 13:22:15.511172 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 441/792] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:22:15 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1260 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:22:15.751803 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-bc5b1ebe-6ca6-4758-ab3c-ba5e183e44c9 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:22:15.752759 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-bc5b1ebe-6ca6-4758-ab3c-ba5e183e44c9 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 51ec80af-a515-409f-a251-9d0a9718889b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:22:15.760948 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-bc5b1ebe-6ca6-4758-ab3c-ba5e183e44c9 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:15.761401 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-bc5b1ebe-6ca6-4758-ab3c-ba5e183e44c9 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:15.762218 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-bc5b1ebe-6ca6-4758-ab3c-ba5e183e44c9 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:15.762658 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-bc5b1ebe-6ca6-4758-ab3c-ba5e183e44c9 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:15.911306 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-bc5b1ebe-6ca6-4758-ab3c-ba5e183e44c9 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action" status: 200 len: 38241 microversion: 2.1 time: 0.163492 Apr 30 13:22:15.912219 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 352/793] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:22:15 2021] POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action => generated 38241 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:22:16.430640 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-29dd649c-b8c6-4ea1-9d3f-85d209b6038f tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750163bf70>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:16.523694 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-29dd649c-b8c6-4ea1-9d3f-85d209b6038f tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.096336 Apr 30 13:22:16.523891 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 442/794] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:16 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:22:16.528440 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-e91d1642-4af3-43f5-9f63-74d365206f2c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:16.529138 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-e91d1642-4af3-43f5-9f63-74d365206f2c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:22:16.538179 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e91d1642-4af3-43f5-9f63-74d365206f2c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:16.538627 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e91d1642-4af3-43f5-9f63-74d365206f2c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:16.539400 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e91d1642-4af3-43f5-9f63-74d365206f2c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:16.539837 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e91d1642-4af3-43f5-9f63-74d365206f2c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:16.745048 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-e91d1642-4af3-43f5-9f63-74d365206f2c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:22:16.753965 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-e91d1642-4af3-43f5-9f63-74d365206f2c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1260 microversion: 2.1 time: 0.229609 Apr 30 13:22:16.754634 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 353/795] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:22:16 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1260 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:22:16.923468 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-ce9a2441-84d9-4696-b971-466fe780077f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:22:16.924385 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-ce9a2441-84d9-4696-b971-466fe780077f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 51ec80af-a515-409f-a251-9d0a9718889b] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:22:16.932106 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ce9a2441-84d9-4696-b971-466fe780077f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:16.932708 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ce9a2441-84d9-4696-b971-466fe780077f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:16.933502 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ce9a2441-84d9-4696-b971-466fe780077f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:16.933941 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ce9a2441-84d9-4696-b971-466fe780077f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:17.069337 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-ce9a2441-84d9-4696-b971-466fe780077f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action" status: 200 len: 38241 microversion: 2.1 time: 0.149748 Apr 30 13:22:17.069986 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 443/796] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:22:16 2021] POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action => generated 38241 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 13:22:17.536569 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-7be60eda-dbf7-40fa-936a-1c401a1b79c8 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750024fdc0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:17.626913 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-7be60eda-dbf7-40fa-936a-1c401a1b79c8 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.094355 Apr 30 13:22:17.627573 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 354/797] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:17 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:22:17.771158 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-74072233-c7ac-4036-9d95-04c0fdca1b58 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:17.771975 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-74072233-c7ac-4036-9d95-04c0fdca1b58 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:22:17.781659 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-74072233-c7ac-4036-9d95-04c0fdca1b58 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:17.782140 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-74072233-c7ac-4036-9d95-04c0fdca1b58 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:17.782926 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-74072233-c7ac-4036-9d95-04c0fdca1b58 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:17.783378 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-74072233-c7ac-4036-9d95-04c0fdca1b58 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:17.986715 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-74072233-c7ac-4036-9d95-04c0fdca1b58 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:22:17.995656 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-74072233-c7ac-4036-9d95-04c0fdca1b58 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1260 microversion: 2.1 time: 0.227923 Apr 30 13:22:17.995656 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 444/798] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:22:17 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1260 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:22:18.082108 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-54632a6e-98f7-4f35-a711-d4a42f73d71a tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:22:18.083044 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-54632a6e-98f7-4f35-a711-d4a42f73d71a tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 51ec80af-a515-409f-a251-9d0a9718889b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:22:18.091108 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-54632a6e-98f7-4f35-a711-d4a42f73d71a tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:18.091575 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-54632a6e-98f7-4f35-a711-d4a42f73d71a tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:18.092491 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-54632a6e-98f7-4f35-a711-d4a42f73d71a tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:18.093568 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-54632a6e-98f7-4f35-a711-d4a42f73d71a tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:18.231176 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-54632a6e-98f7-4f35-a711-d4a42f73d71a tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action" status: 200 len: 38372 microversion: 2.1 time: 0.152787 Apr 30 13:22:18.237410 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 355/799] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:22:18 2021] POST /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/action => generated 38372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:22:18.242734 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-a40c1c46-e700-4c17-9465-aa8114f41334 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:18.243671 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-a40c1c46-e700-4c17-9465-aa8114f41334 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 51ec80af-a515-409f-a251-9d0a9718889b] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:22:18.252546 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a40c1c46-e700-4c17-9465-aa8114f41334 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:18.253088 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a40c1c46-e700-4c17-9465-aa8114f41334 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:18.254106 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a40c1c46-e700-4c17-9465-aa8114f41334 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:18.254585 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a40c1c46-e700-4c17-9465-aa8114f41334 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:18.315985 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-a40c1c46-e700-4c17-9465-aa8114f41334 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "GET /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/ips" status: 200 len: 146 microversion: 2.1 time: 0.076924 Apr 30 13:22:18.316222 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [req-c92e487e-e8ad-4d29-a4c2-7628ef7696b8 req-693218ef-b7e7-431f-b943-78945255ca2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d5ad250-b1c3-4849-9018-b9814f65927c", "name": "network-vif-plugged", "status": "completed", "tag": "1ca6d999-b984-4833-8b8f-a6e9c0526e9e"}]} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:22:18.316567 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 445/800] 10.222.0.79 () {58 vars in 1248 bytes} [Fri Apr 30 13:22:18 2021] GET /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b/ips => generated 146 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:22:18.317747 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:22:18.317747 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: warnings.warn(msg) Apr 30 13:22:18.326628 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-c92e487e-e8ad-4d29-a4c2-7628ef7696b8 req-693218ef-b7e7-431f-b943-78945255ca2d service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:18.327107 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-c92e487e-e8ad-4d29-a4c2-7628ef7696b8 req-693218ef-b7e7-431f-b943-78945255ca2d service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:18.345413 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.compute.server_external_events [req-c92e487e-e8ad-4d29-a4c2-7628ef7696b8 req-693218ef-b7e7-431f-b943-78945255ca2d service nova] Creating event network-vif-plugged:1ca6d999-b984-4833-8b8f-a6e9c0526e9e for instance 9d5ad250-b1c3-4849-9018-b9814f65927c on hv-cinder-78836 Apr 30 13:22:18.350449 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [req-c92e487e-e8ad-4d29-a4c2-7628ef7696b8 req-693218ef-b7e7-431f-b943-78945255ca2d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099724 Apr 30 13:22:18.351049 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 356/801] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:22:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:22:18.639345 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-6527eed8-6791-4f5d-9cfb-c055aff858e4 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500146940>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:18.731993 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-6527eed8-6791-4f5d-9cfb-c055aff858e4 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.096385 Apr 30 13:22:18.732568 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 446/802] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:18 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:22:19.013176 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-3ff2f9b0-a3e0-4b4a-a5f3-a325c8e47b4b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:19.013882 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-3ff2f9b0-a3e0-4b4a-a5f3-a325c8e47b4b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:22:19.021549 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3ff2f9b0-a3e0-4b4a-a5f3-a325c8e47b4b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:19.022039 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3ff2f9b0-a3e0-4b4a-a5f3-a325c8e47b4b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:19.022818 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3ff2f9b0-a3e0-4b4a-a5f3-a325c8e47b4b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:19.023258 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3ff2f9b0-a3e0-4b4a-a5f3-a325c8e47b4b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:19.227872 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-3ff2f9b0-a3e0-4b4a-a5f3-a325c8e47b4b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:22:19.236992 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-3ff2f9b0-a3e0-4b4a-a5f3-a325c8e47b4b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1260 microversion: 2.1 time: 0.228423 Apr 30 13:22:19.237578 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 357/803] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:22:19 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1260 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:22:19.745138 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-552f6aff-d6f4-4d20-9764-c46648a5081f tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750022b550>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:19.841548 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-552f6aff-d6f4-4d20-9764-c46648a5081f tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.100637 Apr 30 13:22:19.842569 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 447/804] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:19 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:22:20.254354 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-1151b424-f05a-434e-a3db-b215155c0501 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:20.254975 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-1151b424-f05a-434e-a3db-b215155c0501 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:22:20.262991 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1151b424-f05a-434e-a3db-b215155c0501 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:20.263458 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1151b424-f05a-434e-a3db-b215155c0501 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:20.264353 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1151b424-f05a-434e-a3db-b215155c0501 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:20.264734 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1151b424-f05a-434e-a3db-b215155c0501 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:20.463777 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-1151b424-f05a-434e-a3db-b215155c0501 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:22:20.472297 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-1151b424-f05a-434e-a3db-b215155c0501 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1443 microversion: 2.1 time: 0.221644 Apr 30 13:22:20.472870 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 358/805] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:22:20 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1443 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:22:20.488628 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-153d07c2-577e-4147-a1cb-84f1a85a3272 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:20.489252 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-153d07c2-577e-4147-a1cb-84f1a85a3272 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:22:20.497320 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-153d07c2-577e-4147-a1cb-84f1a85a3272 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:20.497775 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-153d07c2-577e-4147-a1cb-84f1a85a3272 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:20.499266 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-153d07c2-577e-4147-a1cb-84f1a85a3272 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:20.499953 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-153d07c2-577e-4147-a1cb-84f1a85a3272 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:20.695356 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-153d07c2-577e-4147-a1cb-84f1a85a3272 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:22:20.704434 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-153d07c2-577e-4147-a1cb-84f1a85a3272 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1443 microversion: 2.1 time: 0.219489 Apr 30 13:22:20.705006 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 448/806] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:22:20 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1443 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:22:20.854795 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-216f66be-313d-4c94-9529-f11fd18519ee tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750024f280>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:20.950387 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-216f66be-313d-4c94-9529-f11fd18519ee tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.099808 Apr 30 13:22:20.951055 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 359/807] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:20 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:22:21.962938 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-bbf6662c-1200-4a89-aa1e-6b6b8a975cd2 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb7d13a0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:22.059435 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-bbf6662c-1200-4a89-aa1e-6b6b8a975cd2 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.100657 Apr 30 13:22:22.060131 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 449/808] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:21 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:22:23.072911 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-b7772785-9ef8-4051-b8c3-3e1fce5a8b6e tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500bbcca0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:23.169888 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-b7772785-9ef8-4051-b8c3-3e1fce5a8b6e tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.101162 Apr 30 13:22:23.171113 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 360/809] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:23 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:22:23.424106 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [req-ab011fa7-ed6c-4d22-875f-201ce4f3f3c2 req-45e89758-dd11-47d7-b79e-e074612bce01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d5ad250-b1c3-4849-9018-b9814f65927c", "tag": "1ca6d999-b984-4833-8b8f-a6e9c0526e9e"}]} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:22:23.425720 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:22:23.425720 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: warnings.warn(msg) Apr 30 13:22:23.434875 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-ab011fa7-ed6c-4d22-875f-201ce4f3f3c2 req-45e89758-dd11-47d7-b79e-e074612bce01 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:22:23.435407 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-ab011fa7-ed6c-4d22-875f-201ce4f3f3c2 req-45e89758-dd11-47d7-b79e-e074612bce01 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:22:23.451498 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.compute.server_external_events [req-ab011fa7-ed6c-4d22-875f-201ce4f3f3c2 req-45e89758-dd11-47d7-b79e-e074612bce01 service nova] Creating event network-changed:1ca6d999-b984-4833-8b8f-a6e9c0526e9e for instance 9d5ad250-b1c3-4849-9018-b9814f65927c on hv-cinder-78836 Apr 30 13:22:23.456969 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [req-ab011fa7-ed6c-4d22-875f-201ce4f3f3c2 req-45e89758-dd11-47d7-b79e-e074612bce01 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093143 Apr 30 13:22:23.457679 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 450/810] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:22:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:22:24.183890 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-f817ebb4-2e94-45c0-b46e-0a5acc22884d tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500161e50>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:24.283048 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-f817ebb4-2e94-45c0-b46e-0a5acc22884d tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.103075 Apr 30 13:22:24.283863 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 361/811] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:24 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:22:25.296386 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-acd7145b-0241-4619-8d2b-46a21278ed87 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500bad820>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:25.386978 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-acd7145b-0241-4619-8d2b-46a21278ed87 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.095283 Apr 30 13:22:25.387784 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 451/812] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:25 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:22:26.400354 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-6f48690e-59be-44ed-85d4-bfe08c070383 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500161940>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:26.491342 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-6f48690e-59be-44ed-85d4-bfe08c070383 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.094771 Apr 30 13:22:26.491956 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 362/813] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:26 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:22:27.504929 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-d17044be-6b5d-4d88-98a9-f530d4efc35a tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750022bee0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:27.600316 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-d17044be-6b5d-4d88-98a9-f530d4efc35a tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.099429 Apr 30 13:22:27.600957 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 452/814] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:27 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:22:28.613419 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-98681648-c13c-4fe4-aa8e-c36dd8a5c994 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750005ea60>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:28.706984 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-98681648-c13c-4fe4-aa8e-c36dd8a5c994 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.097634 Apr 30 13:22:28.707590 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 363/815] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:28 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:22:29.720662 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-513405e1-8df9-4272-b4f4-d8236930b8f2 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb7d6280>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:29.816237 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-513405e1-8df9-4272-b4f4-d8236930b8f2 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.099337 Apr 30 13:22:29.817030 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 453/816] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:29 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:22:30.829351 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-b614d443-354c-423a-be88-c2251daa13c7 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500bff940>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:30.928080 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-b614d443-354c-423a-be88-c2251daa13c7 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.102827 Apr 30 13:22:30.928786 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 364/817] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:30 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:22:31.941485 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-fc4a0bd0-ef56-4e61-8df5-896d7df460bc tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500080d30>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:32.032201 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-fc4a0bd0-ef56-4e61-8df5-896d7df460bc tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.095292 Apr 30 13:22:32.032781 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 454/818] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:31 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:22:33.044891 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-6abbdea6-056f-45fa-8ddb-1b99edd7b72f tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fbfc9280>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:33.137292 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-6abbdea6-056f-45fa-8ddb-1b99edd7b72f tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.096015 Apr 30 13:22:33.138059 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 365/819] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:33 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:22:34.149811 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-ba31a0eb-2f4a-4b0a-8e6a-16a34fbd2a1a tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f75001468b0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:34.245476 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-ba31a0eb-2f4a-4b0a-8e6a-16a34fbd2a1a tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.099395 Apr 30 13:22:34.246078 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 455/820] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:34 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:22:35.257406 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-d1c4469a-3e47-40cf-bf6f-b280305ba8a5 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750024fdc0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:35.349749 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-d1c4469a-3e47-40cf-bf6f-b280305ba8a5 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.095982 Apr 30 13:22:35.350361 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 366/821] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:35 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:22:36.363465 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b3af609c-b62e-4145-9fb2-808379acfd8f tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb7d6310>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:36.471818 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b3af609c-b62e-4145-9fb2-808379acfd8f tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.112308 Apr 30 13:22:36.472552 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 456/822] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:36 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:22:37.484746 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-27508de5-1f13-4850-863e-6072a835433b tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500161940>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:37.577905 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-27508de5-1f13-4850-863e-6072a835433b tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.097871 Apr 30 13:22:37.578539 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 367/823] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:37 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:22:38.591061 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-83007e1d-8d8f-4002-bbb2-80b26d333531 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500bad940>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:38.695644 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-83007e1d-8d8f-4002-bbb2-80b26d333531 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.108202 Apr 30 13:22:38.696222 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 457/824] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:38 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:22:39.709896 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-7e9d85a6-6317-4f52-9b43-5d3529015ef0 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f75014eeb80>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:39.805913 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-7e9d85a6-6317-4f52-9b43-5d3529015ef0 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.101023 Apr 30 13:22:39.806843 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 368/825] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:39 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:22:40.818514 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b3089fb2-55a1-4629-9519-b19a568f7bd2 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500080280>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:40.909658 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b3089fb2-55a1-4629-9519-b19a568f7bd2 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.094957 Apr 30 13:22:40.910329 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 458/826] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:40 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:22:41.930926 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-291c0502-d5b3-4296-a2d1-d460d969f112 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500bffc10>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:42.049421 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-291c0502-d5b3-4296-a2d1-d460d969f112 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.128410 Apr 30 13:22:42.050639 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 369/827] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:41 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:22:43.062631 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-4914732f-6d1b-4e2a-a313-95b3c41d4382 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb738ee0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:43.162191 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-4914732f-6d1b-4e2a-a313-95b3c41d4382 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.103381 Apr 30 13:22:43.162899 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 459/828] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:43 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:22:44.176783 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-79f18f50-fbb1-4653-8fdd-b96028b41d9c tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fbfc9280>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:44.287294 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-79f18f50-fbb1-4653-8fdd-b96028b41d9c tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.115614 Apr 30 13:22:44.288101 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 370/829] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:44 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:22:45.301428 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b5f0802a-34c1-414d-abf0-e57afd31f660 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500130670>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:45.393194 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b5f0802a-34c1-414d-abf0-e57afd31f660 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.094875 Apr 30 13:22:45.393777 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 460/830] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:45 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:22:46.407133 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-9d7e7986-961e-4467-a6b6-68272baa0c49 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fbfc90d0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:46.506252 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-9d7e7986-961e-4467-a6b6-68272baa0c49 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.103806 Apr 30 13:22:46.507258 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 371/831] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:46 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:22:47.519283 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-0ea23c1f-fe06-4d13-a9a8-22963c2570e8 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500357820>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:47.733883 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-0ea23c1f-fe06-4d13-a9a8-22963c2570e8 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.218045 Apr 30 13:22:47.734740 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 461/832] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:47 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:22:48.747553 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-179ab816-193b-46da-a3a9-1d156916f982 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750024f280>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:48.850569 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-179ab816-193b-46da-a3a9-1d156916f982 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.107481 Apr 30 13:22:48.856199 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 372/833] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:48 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:22:49.864941 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-e9020c8e-911a-403e-b83e-5ed6b2a8b6ee tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500146160>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:49.963395 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-e9020c8e-911a-403e-b83e-5ed6b2a8b6ee tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.103308 Apr 30 13:22:49.969031 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 462/834] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:49 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:22:50.975859 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-1e3dee79-cc55-47fa-be14-3d5435af3f26 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500b40820>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:51.069605 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-1e3dee79-cc55-47fa-be14-3d5435af3f26 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.097714 Apr 30 13:22:51.070846 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 373/835] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:50 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:22:52.083312 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-d6ca0541-77e4-4a7f-bd36-a312300d4721 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500bad8b0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:52.179048 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-d6ca0541-77e4-4a7f-bd36-a312300d4721 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.099489 Apr 30 13:22:52.179633 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 463/836] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:52 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:22:53.196074 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-0bc6404c-65bc-40d5-b259-b9439d5ba6d2 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f75014ee9d0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:53.292934 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-0bc6404c-65bc-40d5-b259-b9439d5ba6d2 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.100889 Apr 30 13:22:53.293562 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 374/837] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:53 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:22:54.306582 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-c3c2d6ce-ead3-431c-92e0-3878f55a7159 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb738c10>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:54.398354 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-c3c2d6ce-ead3-431c-92e0-3878f55a7159 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.095993 Apr 30 13:22:54.399291 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 464/838] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:54 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:22:55.410296 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-f7ad490b-6021-480b-a90d-ca573551b75a tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500bfff70>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:55.507454 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-f7ad490b-6021-480b-a90d-ca573551b75a tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.100423 Apr 30 13:22:55.512901 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 375/839] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:55 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:22:56.520519 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-d7c2f207-9d1a-4cdb-9120-57c5b068a33a tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750022b790>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:56.614122 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-d7c2f207-9d1a-4cdb-9120-57c5b068a33a tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.097324 Apr 30 13:22:56.619955 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 465/840] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:56 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:22:57.627319 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-6fb38175-1697-45df-ba5f-be511c1a3ed5 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500b40d30>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:57.743863 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-6fb38175-1697-45df-ba5f-be511c1a3ed5 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.120182 Apr 30 13:22:57.744565 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 376/841] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:57 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:22:58.757434 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-d9fe727c-b8bf-41b3-805f-7f56c31cf114 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750022b040>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:58.850057 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-d9fe727c-b8bf-41b3-805f-7f56c31cf114 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.096328 Apr 30 13:22:58.856039 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 466/842] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:58 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:22:59.863843 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-f96d7b64-2ef2-4594-927f-d5fc2880dac3 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fbfc9ca0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:22:59.959828 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-f96d7b64-2ef2-4594-927f-d5fc2880dac3 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.099738 Apr 30 13:22:59.960410 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 377/843] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:22:59 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:23:00.973493 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-fc3b7e93-2dd1-4435-ac2d-af251ab1a605 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb738af0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:01.066486 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-fc3b7e93-2dd1-4435-ac2d-af251ab1a605 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.097042 Apr 30 13:23:01.067267 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 467/844] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:23:00 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:23:02.078616 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-a085e585-f623-4956-a5a1-d650b6ca61de tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750024fdc0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:02.174502 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-a085e585-f623-4956-a5a1-d650b6ca61de tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.099777 Apr 30 13:23:02.175074 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 378/845] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:23:02 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:23:03.189405 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-f6a2f51c-1081-4e80-9664-2b813dbbc09c tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500146940>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:03.288297 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-f6a2f51c-1081-4e80-9664-2b813dbbc09c tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.103623 Apr 30 13:23:03.289223 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 468/846] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:23:03 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:23:04.301117 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-d512104c-2938-4845-bab7-d8b49affc87c tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500b40670>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:04.405387 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-d512104c-2938-4845-bab7-d8b49affc87c tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.107972 Apr 30 13:23:04.410296 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 379/847] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:23:04 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:23:05.417971 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-d0d4817b-f5c8-44aa-9ebc-2c5c67a67236 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500c6f160>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:05.514672 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-d0d4817b-f5c8-44aa-9ebc-2c5c67a67236 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.100837 Apr 30 13:23:05.515447 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 469/848] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:23:05 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:23:06.528840 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-6f980a89-1316-4469-b1af-582b664b95b0 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750024fa60>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:06.623683 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-6f980a89-1316-4469-b1af-582b664b95b0 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.099784 Apr 30 13:23:06.624288 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 380/849] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:23:06 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:23:07.637711 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-031ebb12-668b-4f0d-adc9-cf5ce6de48d8 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750036ff70>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:07.730176 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-031ebb12-668b-4f0d-adc9-cf5ce6de48d8 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.095970 Apr 30 13:23:07.730878 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 470/850] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:23:07 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:23:08.744596 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-eea947d3-9f56-460a-a5f1-a7a16e8a5e51 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500161f70>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:08.842212 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-eea947d3-9f56-460a-a5f1-a7a16e8a5e51 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.101659 Apr 30 13:23:08.844003 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 381/851] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:23:08 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:23:09.859124 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-93823478-3d27-4877-bb4d-400efcc6486d tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500130ee0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:09.988878 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-93823478-3d27-4877-bb4d-400efcc6486d tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.133920 Apr 30 13:23:09.989470 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 471/852] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:23:09 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:23:11.001769 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-0d59b941-0a14-421d-abe9-3d28f01e96b4 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f75014ee9d0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:11.145740 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-0d59b941-0a14-421d-abe9-3d28f01e96b4 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.148452 Apr 30 13:23:11.146522 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 382/853] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:23:10 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:23:12.158371 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-a5832912-9b8b-4606-97ba-2ea06ae52cfb tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750022b040>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:12.251971 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-a5832912-9b8b-4606-97ba-2ea06ae52cfb tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.097422 Apr 30 13:23:12.252547 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 472/854] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:23:12 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:23:13.264704 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-7295ddbb-20a1-42ae-bc4b-d7dd25274957 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f75014eeb80>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:13.361808 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-7295ddbb-20a1-42ae-bc4b-d7dd25274957 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.100511 Apr 30 13:23:13.362869 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 383/855] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:23:13 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:23:14.375261 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-592b47cc-6b34-49a6-932f-a0ec0893a09c tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb738af0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:14.474719 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-592b47cc-6b34-49a6-932f-a0ec0893a09c tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.103866 Apr 30 13:23:14.475292 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 473/856] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:23:14 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:23:15.491372 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-17c76dc2-537b-43bf-b1f8-696ea20dbca9 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500bff940>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:15.585169 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-17c76dc2-537b-43bf-b1f8-696ea20dbca9 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.097434 Apr 30 13:23:15.585747 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 384/857] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:23:15 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:23:16.597765 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-dcc01217-29f8-4ac4-aee5-a49fe15d4109 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500bad9d0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:16.692282 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-dcc01217-29f8-4ac4-aee5-a49fe15d4109 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.097564 Apr 30 13:23:16.693183 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 474/858] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:23:16 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:23:17.705245 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-dbd98792-0f1e-4f6c-a7b8-2396d182caeb tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750024f160>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:17.799464 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-dbd98792-0f1e-4f6c-a7b8-2396d182caeb tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.097254 Apr 30 13:23:17.804550 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 385/859] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:23:17 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:23:18.816084 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-27d609fc-e2b7-47f7-ac1d-47157a083f06 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb7d1e50>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:18.931912 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-27d609fc-e2b7-47f7-ac1d-47157a083f06 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.122956 Apr 30 13:23:18.932485 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 475/860] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:23:18 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:23:19.949081 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-541f002c-d053-44b3-9b35-b4c1cf40c3e4 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750024f280>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:20.046824 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-541f002c-d053-44b3-9b35-b4c1cf40c3e4 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.104644 Apr 30 13:23:20.047394 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 386/861] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:23:19 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:23:21.063433 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-16f3e69e-c0ea-420b-a673-346b89722fbf tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb7d14c0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:21.164951 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-16f3e69e-c0ea-420b-a673-346b89722fbf tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.108689 Apr 30 13:23:21.166117 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 476/862] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:23:21 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:23:22.181042 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-32f37044-b0d9-490c-8f32-799c33d03ba2 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500161f70>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:22.275417 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-32f37044-b0d9-490c-8f32-799c33d03ba2 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.098391 Apr 30 13:23:22.275993 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 387/863] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:23:22 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:23:23.292047 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-64c88f5f-839a-44d7-beac-7c642a9d12da tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500c6fc10>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:23.424985 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-64c88f5f-839a-44d7-beac-7c642a9d12da tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.139603 Apr 30 13:23:23.426312 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 477/864] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:23:23 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:23:24.444189 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-277da3dc-f752-4f50-9d7a-d27a0516d199 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f75014eeb80>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:24.545763 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-277da3dc-f752-4f50-9d7a-d27a0516d199 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.108013 Apr 30 13:23:24.556757 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 388/865] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:23:24 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:23:25.564894 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-0a7bf367-f62e-4ca7-8e3c-c5d00d464fc3 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750036f670>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:25.659959 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-0a7bf367-f62e-4ca7-8e3c-c5d00d464fc3 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.098736 Apr 30 13:23:25.660962 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 478/866] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:23:25 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:23:26.672930 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-74708044-1eec-470d-ad19-2ca9da16410c tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750011fc10>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:26.789355 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-74708044-1eec-470d-ad19-2ca9da16410c tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.120708 Apr 30 13:23:26.789925 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 389/867] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:23:26 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:23:27.806643 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-ac99430d-5707-4b36-8f5b-d83e5d44ca0c tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750022b280>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:27.898095 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-ac99430d-5707-4b36-8f5b-d83e5d44ca0c tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.095033 Apr 30 13:23:27.899051 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 479/868] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:23:27 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:23:28.914256 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-ed923869-58ae-4fe5-9bdd-37a10b27d58a tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fbfc9b80>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:29.045643 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-ed923869-58ae-4fe5-9bdd-37a10b27d58a tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.138394 Apr 30 13:23:29.046303 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 390/869] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:23:28 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:23:30.058608 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-25b180e0-1955-47c6-bc05-2efb9c409d37 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750022b430>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:30.148518 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-25b180e0-1955-47c6-bc05-2efb9c409d37 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.093754 Apr 30 13:23:30.149091 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 480/870] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:23:30 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:23:31.164211 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-92e9baab-6bda-46dd-b1af-95d8dbbebbd4 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750011f280>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:31.275102 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-92e9baab-6bda-46dd-b1af-95d8dbbebbd4 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.115709 Apr 30 13:23:31.275670 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 391/871] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:23:31 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:23:32.290279 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-f73d1fa8-8153-4e71-9940-91a9b49a1e89 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb738c10>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:32.385656 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-f73d1fa8-8153-4e71-9940-91a9b49a1e89 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.098933 Apr 30 13:23:32.386474 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 481/872] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:23:32 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:23:33.399732 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-d0d7b396-3558-4d8f-af89-0aa2cb2c9d82 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500bbc9d0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:33.500975 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-d0d7b396-3558-4d8f-af89-0aa2cb2c9d82 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.104690 Apr 30 13:23:33.502284 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 392/873] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:23:33 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:23:34.515751 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-5b0300f0-6d87-44ca-8ae8-2175ea5f4d81 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500bad940>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:34.625537 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-5b0300f0-6d87-44ca-8ae8-2175ea5f4d81 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.113939 Apr 30 13:23:34.626142 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 482/874] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:23:34 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:23:35.639222 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-ee053732-71a7-41cd-ba7a-de2f88450758 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500bff790>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:35.762481 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-ee053732-71a7-41cd-ba7a-de2f88450758 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.127530 Apr 30 13:23:35.768096 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 393/875] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:23:35 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:23:36.776436 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-e768b551-2f3b-4923-8e6c-63e09e958cee tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb7d1c10>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:36.877327 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-e768b551-2f3b-4923-8e6c-63e09e958cee tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.104583 Apr 30 13:23:36.878358 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 483/876] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:23:36 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:23:37.893353 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-4c705c92-04a7-4d1c-92df-6d0fb64fed4e tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750024f9d0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:37.987509 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-4c705c92-04a7-4d1c-92df-6d0fb64fed4e tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.097806 Apr 30 13:23:37.988171 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 394/877] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:23:37 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:23:39.001808 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-58b9ebae-9418-4c19-8f8f-695044d441a9 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb7d14c0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:39.096071 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-58b9ebae-9418-4c19-8f8f-695044d441a9 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.098046 Apr 30 13:23:39.096695 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 484/878] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:23:38 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:23:40.110300 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-ecc43ffe-0078-4c96-ae8b-346507acbae0 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500bbcb80>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:40.205556 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-ecc43ffe-0078-4c96-ae8b-346507acbae0 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.099667 Apr 30 13:23:40.206287 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 395/879] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:23:40 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:23:41.223084 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-34f7d21b-ed17-4d56-86fc-c83513cb867c tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500bad820>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:41.343445 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-34f7d21b-ed17-4d56-86fc-c83513cb867c tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.126860 Apr 30 13:23:41.344896 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 485/880] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:23:41 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:23:42.363538 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-c2729bde-1870-44f1-8daf-a732d62909a0 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750011fe50>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:42.414845 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:23:42.415760 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: Fri Apr 30 13:23:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:23:42.477839 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-c2729bde-1870-44f1-8daf-a732d62909a0 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.120584 Apr 30 13:23:42.483355 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 396/881] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:23:42 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:23:43.491899 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-7221870e-4320-4387-b7f5-b119395c3cc4 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb738dc0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:43.600291 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-7221870e-4320-4387-b7f5-b119395c3cc4 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.112571 Apr 30 13:23:43.601131 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 486/882] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:23:43 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:23:44.616570 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-1cdd584f-c412-4f0f-a5f9-58e08b49f395 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750011f1f0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:44.724685 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-1cdd584f-c412-4f0f-a5f9-58e08b49f395 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.114071 Apr 30 13:23:44.725410 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 397/883] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:23:44 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:23:45.737556 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-7a0a2240-eaa3-4375-a5bd-d08770b4edbc tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750022b040>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:45.838730 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-7a0a2240-eaa3-4375-a5bd-d08770b4edbc tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.104558 Apr 30 13:23:45.839713 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 487/884] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:23:45 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:23:46.854619 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-67a3998d-20e9-44ad-880c-d592f36488c0 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fbfc98b0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:46.957923 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-67a3998d-20e9-44ad-880c-d592f36488c0 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.107556 Apr 30 13:23:46.958645 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 398/885] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:23:46 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:23:47.373147 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:23:47.373385 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: Fri Apr 30 13:23:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:23:47.970882 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-a9b06f1f-5152-460a-8694-83d7acf4641a tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750036f8b0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:48.070436 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-a9b06f1f-5152-460a-8694-83d7acf4641a tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.102991 Apr 30 13:23:48.071301 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 488/886] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:23:47 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:23:49.084184 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-a53abd75-a3b8-4c3c-b8bf-6b366b62d439 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f75014eec10>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:49.179906 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-a53abd75-a3b8-4c3c-b8bf-6b366b62d439 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.099308 Apr 30 13:23:49.180521 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 399/887] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:23:49 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:23:50.193057 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-e9ca162a-37ea-4e74-bcc8-fc5d939f4144 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500c6f670>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:50.292119 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-e9ca162a-37ea-4e74-bcc8-fc5d939f4144 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.102446 Apr 30 13:23:50.293589 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 489/888] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:23:50 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:23:51.306768 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-c8da8518-6c48-489d-8cb3-c00720673d9d tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500bbcca0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:51.406113 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-c8da8518-6c48-489d-8cb3-c00720673d9d tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.103211 Apr 30 13:23:51.406933 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 400/889] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:23:51 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:23:52.418433 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-44ddcea3-994a-463a-a001-c6d3c643482a tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb7d6ee0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:52.516310 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-44ddcea3-994a-463a-a001-c6d3c643482a tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.101726 Apr 30 13:23:52.516990 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 490/890] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:23:52 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:23:53.530250 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-fc894d3f-e73b-45f5-a7ec-2936e516cbf9 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750011fa60>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:53.624097 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-fc894d3f-e73b-45f5-a7ec-2936e516cbf9 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.098297 Apr 30 13:23:53.624725 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 401/891] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:23:53 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:23:54.636326 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-db36ca9f-3ff7-43d0-b6b0-39cd34a14ba8 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb7d6ca0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:54.743141 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-db36ca9f-3ff7-43d0-b6b0-39cd34a14ba8 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.109805 Apr 30 13:23:54.744102 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 491/892] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:23:54 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:23:55.758364 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-635dfba7-1fe6-4ca2-8d80-9adc7bf332b7 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fbfc98b0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:55.859038 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-635dfba7-1fe6-4ca2-8d80-9adc7bf332b7 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.104195 Apr 30 13:23:55.860184 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 402/893] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:23:55 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:23:56.872862 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-6bca6e68-610d-4aa4-bdf5-181fedca70de tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500c6f9d0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:56.971464 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-6bca6e68-610d-4aa4-bdf5-181fedca70de tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.103414 Apr 30 13:23:56.972313 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 492/894] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:23:56 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:23:57.985902 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-ac5dcdc6-d067-496a-bea8-c18b30ff4725 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750024ff70>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:58.081072 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-ac5dcdc6-d067-496a-bea8-c18b30ff4725 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.098802 Apr 30 13:23:58.081727 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 403/895] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:23:57 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:23:59.094944 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-9c2d72eb-4c74-4aa1-830e-09d334b4f991 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750036f280>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:23:59.189610 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-9c2d72eb-4c74-4aa1-830e-09d334b4f991 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.098293 Apr 30 13:23:59.190282 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 493/896] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:23:59 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:24:00.202538 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-37a96625-5289-4aa6-927b-c8b180eeb13d tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500bfff70>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:00.298239 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-37a96625-5289-4aa6-927b-c8b180eeb13d tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.098921 Apr 30 13:24:00.299382 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 404/897] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:00 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:24:01.312569 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-a44223b1-04b7-48a1-93a4-c42966aec932 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500130d30>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:01.404490 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-a44223b1-04b7-48a1-93a4-c42966aec932 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.096584 Apr 30 13:24:01.405133 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 494/898] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:01 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:24:02.421737 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-d6793c27-076e-4d9b-a914-49b5249a32a5 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fbfc9280>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:02.523738 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-d6793c27-076e-4d9b-a914-49b5249a32a5 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.108899 Apr 30 13:24:02.524375 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 405/899] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:02 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:24:03.539880 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-db1715da-b6a9-452f-b3e1-1b764452bbff tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750022b550>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:03.644715 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-db1715da-b6a9-452f-b3e1-1b764452bbff tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.109071 Apr 30 13:24:03.645277 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 495/900] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:03 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:24:04.657688 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-03e5215b-a7e7-4a51-bad0-da19a32dd065 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750011f430>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:04.755642 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-03e5215b-a7e7-4a51-bad0-da19a32dd065 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.101784 Apr 30 13:24:04.756325 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 406/901] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:04 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:24:05.769071 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-6901daca-f010-4f38-9d9d-1c004e3294b2 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750036fe50>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:05.861074 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-6901daca-f010-4f38-9d9d-1c004e3294b2 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.095922 Apr 30 13:24:05.861664 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 496/902] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:05 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:24:06.873315 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-bb8ad836-9977-4ce4-89b7-cc82bf37e36c tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500b409d0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:06.970856 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-bb8ad836-9977-4ce4-89b7-cc82bf37e36c tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.101705 Apr 30 13:24:06.971429 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 407/903] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:06 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:24:07.983571 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-803847d5-b80b-4e11-97fd-e125f58886d6 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500c6f550>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:08.076536 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-803847d5-b80b-4e11-97fd-e125f58886d6 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.096712 Apr 30 13:24:08.077189 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 497/904] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:07 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:24:09.089868 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-02da1eb6-3afb-4123-8736-9ee792cb433e tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500bbc9d0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:09.184239 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-02da1eb6-3afb-4123-8736-9ee792cb433e tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.098781 Apr 30 13:24:09.184827 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 408/905] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:09 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:24:10.197777 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-80cb11dc-4b0a-4fbe-9c4f-e9344173cfc8 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb7d6c10>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:10.293179 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-80cb11dc-4b0a-4fbe-9c4f-e9344173cfc8 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.098116 Apr 30 13:24:10.293897 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 498/906] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:10 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:24:11.307909 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-ad04531f-74a7-41a8-898b-e5b569466409 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750011f280>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:11.403311 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-ad04531f-74a7-41a8-898b-e5b569466409 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.099021 Apr 30 13:24:11.403886 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 409/907] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:11 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:24:12.415877 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-c7fb9bdc-3937-4811-8440-315808f35722 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500c6fc10>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:12.507214 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-c7fb9bdc-3937-4811-8440-315808f35722 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.094908 Apr 30 13:24:12.507791 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 499/908] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:12 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:24:13.520370 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-86834bfa-005f-404d-8d21-813cc577c78d tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fbfc9a60>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:13.618365 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-86834bfa-005f-404d-8d21-813cc577c78d tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.101578 Apr 30 13:24:13.619082 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 410/909] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:13 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:24:14.630983 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-d58963ec-1516-4ffa-86bf-2eca15141c3c tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb7d6d30>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:14.722632 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-d58963ec-1516-4ffa-86bf-2eca15141c3c tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.095169 Apr 30 13:24:14.723201 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 500/910] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:14 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:24:15.735281 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-fbdfb5d2-f655-4467-9652-62ad68233f25 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500b40940>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:15.826886 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-fbdfb5d2-f655-4467-9652-62ad68233f25 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.095232 Apr 30 13:24:15.827461 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 411/911] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:15 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:24:16.839439 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-4c337729-549d-4750-9111-adb09791f000 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb7d14c0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:16.936393 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-4c337729-549d-4750-9111-adb09791f000 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.100850 Apr 30 13:24:16.936958 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 501/912] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:16 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:24:17.948943 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-8cb45751-1673-449f-839a-099d9a6f190b tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500bffc10>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:18.040915 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-8cb45751-1673-449f-839a-099d9a6f190b tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.095969 Apr 30 13:24:18.041486 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 412/913] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:17 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:24:19.053809 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-144edc09-cb7c-4df9-b51a-e650e5025781 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750022b040>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:19.145677 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-144edc09-cb7c-4df9-b51a-e650e5025781 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.095694 Apr 30 13:24:19.146275 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 502/914] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:19 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:24:20.158612 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-b3c7f37c-c9a6-4ca7-bfca-81998861f8f3 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fbfc90d0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:20.253809 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-b3c7f37c-c9a6-4ca7-bfca-81998861f8f3 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.098947 Apr 30 13:24:20.254419 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 413/915] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:20 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:24:21.266189 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b1b2344b-9ee6-4088-ad2e-746cbbe4c417 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750022b550>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:21.354838 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-933bdaff-e322-44c5-a344-047074f75aa1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:24:21.355440 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-933bdaff-e322-44c5-a344-047074f75aa1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:24:21.358267 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b1b2344b-9ee6-4088-ad2e-746cbbe4c417 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.095812 Apr 30 13:24:21.359041 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 503/916] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:21 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:24:21.363796 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-933bdaff-e322-44c5-a344-047074f75aa1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:21.364258 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-933bdaff-e322-44c5-a344-047074f75aa1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:21.365060 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-933bdaff-e322-44c5-a344-047074f75aa1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:21.365504 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-933bdaff-e322-44c5-a344-047074f75aa1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:21.424049 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.objects.instance [None req-933bdaff-e322-44c5-a344-047074f75aa1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lazy-loading 'flavor' on Instance uuid 9d5ad250-b1c3-4849-9018-b9814f65927c {{(pid=87932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:24:21.571934 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-933bdaff-e322-44c5-a344-047074f75aa1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "POST /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c/action" status: 202 len: 0 microversion: 2.1 time: 0.221264 Apr 30 13:24:21.572536 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 414/917] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:24:21 2021] POST /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 13:24:21.585601 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-f20b5989-daed-465b-91d4-1da1801b4cad tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:21.585601 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-f20b5989-daed-465b-91d4-1da1801b4cad tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:24:21.591253 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f20b5989-daed-465b-91d4-1da1801b4cad tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:21.591791 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f20b5989-daed-465b-91d4-1da1801b4cad tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:21.592597 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f20b5989-daed-465b-91d4-1da1801b4cad tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:21.593073 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f20b5989-daed-465b-91d4-1da1801b4cad tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:21.798898 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-f20b5989-daed-465b-91d4-1da1801b4cad tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:24:21.807588 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-f20b5989-daed-465b-91d4-1da1801b4cad tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.230296 Apr 30 13:24:21.808166 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 504/918] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:24:21 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:24:22.371349 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-90e934b9-3930-4c3d-80ee-0b53ec7df410 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750011f040>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:22.463392 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-90e934b9-3930-4c3d-80ee-0b53ec7df410 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.096267 Apr 30 13:24:22.464231 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 415/919] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:22 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:24:22.824872 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b478d445-8431-448c-8e5f-463b6ec7ee25 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:22.825433 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-b478d445-8431-448c-8e5f-463b6ec7ee25 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:24:22.833029 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b478d445-8431-448c-8e5f-463b6ec7ee25 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:22.833479 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b478d445-8431-448c-8e5f-463b6ec7ee25 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:22.834286 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b478d445-8431-448c-8e5f-463b6ec7ee25 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:22.834719 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b478d445-8431-448c-8e5f-463b6ec7ee25 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:23.040605 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-b478d445-8431-448c-8e5f-463b6ec7ee25 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:24:23.049386 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b478d445-8431-448c-8e5f-463b6ec7ee25 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.228583 Apr 30 13:24:23.049977 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 505/920] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:24:22 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:24:23.476646 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-fc1dbdc1-ca89-42f8-b965-3b0cc5de7d9c tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fbfc90d0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:23.569961 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-fc1dbdc1-ca89-42f8-b965-3b0cc5de7d9c tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.097016 Apr 30 13:24:23.570599 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 416/921] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:23 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:24:24.067485 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-e339728e-2d61-40fe-bc32-80fdfb29a3e6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:24.068036 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-e339728e-2d61-40fe-bc32-80fdfb29a3e6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:24:24.076071 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e339728e-2d61-40fe-bc32-80fdfb29a3e6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:24.076526 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e339728e-2d61-40fe-bc32-80fdfb29a3e6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:24.077308 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e339728e-2d61-40fe-bc32-80fdfb29a3e6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:24.077749 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e339728e-2d61-40fe-bc32-80fdfb29a3e6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:24.278673 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-e339728e-2d61-40fe-bc32-80fdfb29a3e6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:24:24.287296 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-e339728e-2d61-40fe-bc32-80fdfb29a3e6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.223706 Apr 30 13:24:24.287858 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 506/922] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:24:24 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:24:24.582813 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-0ee597b0-331b-40d5-b9de-568bd95ae75d tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500bff280>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:24.676491 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-0ee597b0-331b-40d5-b9de-568bd95ae75d tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.097274 Apr 30 13:24:24.677063 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 417/923] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:24 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:24:25.304812 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-24729147-a614-48ce-801a-86812cfd43b9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:25.305439 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-24729147-a614-48ce-801a-86812cfd43b9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:24:25.313252 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-24729147-a614-48ce-801a-86812cfd43b9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:25.313714 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-24729147-a614-48ce-801a-86812cfd43b9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:25.314544 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-24729147-a614-48ce-801a-86812cfd43b9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:25.314995 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-24729147-a614-48ce-801a-86812cfd43b9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:25.517143 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-24729147-a614-48ce-801a-86812cfd43b9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:24:25.525426 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-24729147-a614-48ce-801a-86812cfd43b9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.224382 Apr 30 13:24:25.526143 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 507/924] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:24:25 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:24:25.689254 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-b73473ee-1dab-4ff7-9ff0-528ca554d3d2 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500bffca0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:25.779504 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-b73473ee-1dab-4ff7-9ff0-528ca554d3d2 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.093942 Apr 30 13:24:25.780083 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 418/925] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:25 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:24:26.542973 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-5a6ebb87-2757-4496-b069-d8fd653505e3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:26.543533 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-5a6ebb87-2757-4496-b069-d8fd653505e3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:24:26.550804 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5a6ebb87-2757-4496-b069-d8fd653505e3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:26.551252 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5a6ebb87-2757-4496-b069-d8fd653505e3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:26.552037 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5a6ebb87-2757-4496-b069-d8fd653505e3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:26.552480 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5a6ebb87-2757-4496-b069-d8fd653505e3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:26.754764 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-5a6ebb87-2757-4496-b069-d8fd653505e3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:24:26.763651 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-5a6ebb87-2757-4496-b069-d8fd653505e3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.224558 Apr 30 13:24:26.764251 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 508/926] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:24:26 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:24:26.792311 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-4162b776-2151-48c8-98a4-2a6639316014 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750024f4c0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:26.886604 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-4162b776-2151-48c8-98a4-2a6639316014 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.097755 Apr 30 13:24:26.887194 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 419/927] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:26 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:24:27.780724 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-8cb6eb34-f73c-4182-90eb-0596d43ed774 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:27.781322 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-8cb6eb34-f73c-4182-90eb-0596d43ed774 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:24:27.789181 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8cb6eb34-f73c-4182-90eb-0596d43ed774 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:27.789638 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8cb6eb34-f73c-4182-90eb-0596d43ed774 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:27.790464 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8cb6eb34-f73c-4182-90eb-0596d43ed774 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:27.790912 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8cb6eb34-f73c-4182-90eb-0596d43ed774 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:27.899247 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-596f3ba3-1925-47e8-bb2b-acd6c56badfc tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750011ff70>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:27.927875 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb5a7899-1fdb-42b6-bec0-d69e54b8f5a6] AMQP server on 10.222.0.79:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 13:24:27.992878 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-8cb6eb34-f73c-4182-90eb-0596d43ed774 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:24:27.993504 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-596f3ba3-1925-47e8-bb2b-acd6c56badfc tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.098259 Apr 30 13:24:27.994113 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 420/928] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:27 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:24:28.001863 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-8cb6eb34-f73c-4182-90eb-0596d43ed774 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.224883 Apr 30 13:24:28.002517 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 509/929] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:24:27 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:24:29.005648 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-a238af6b-1a54-45d4-97ed-0f7c3900a2bd tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750011fa60>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:29.019538 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-588210d7-3e66-4aea-b418-7f4ce742f4ad tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:29.020097 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-588210d7-3e66-4aea-b418-7f4ce742f4ad tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:24:29.040229 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-588210d7-3e66-4aea-b418-7f4ce742f4ad tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:29.040687 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-588210d7-3e66-4aea-b418-7f4ce742f4ad tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:29.041485 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-588210d7-3e66-4aea-b418-7f4ce742f4ad tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:29.042171 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-588210d7-3e66-4aea-b418-7f4ce742f4ad tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:29.076849 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb5a7899-1fdb-42b6-bec0-d69e54b8f5a6] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 56938. Apr 30 13:24:29.098330 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-a238af6b-1a54-45d4-97ed-0f7c3900a2bd tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.096590 Apr 30 13:24:29.098868 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 421/930] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:29 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:24:29.273357 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-588210d7-3e66-4aea-b418-7f4ce742f4ad tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:24:29.283977 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-588210d7-3e66-4aea-b418-7f4ce742f4ad tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.268004 Apr 30 13:24:29.284611 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 510/931] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:24:29 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:24:30.111234 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-78e91f4f-d056-4c2e-aece-e56f34f17df9 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750024f9d0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:30.208386 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-78e91f4f-d056-4c2e-aece-e56f34f17df9 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.100795 Apr 30 13:24:30.209072 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 422/932] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:30 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:24:30.300637 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-a9cfb1fa-d0d0-45df-8a4d-329ffe613363 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:30.301443 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-a9cfb1fa-d0d0-45df-8a4d-329ffe613363 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:24:30.309457 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a9cfb1fa-d0d0-45df-8a4d-329ffe613363 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:30.310078 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a9cfb1fa-d0d0-45df-8a4d-329ffe613363 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:30.311138 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a9cfb1fa-d0d0-45df-8a4d-329ffe613363 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:30.311746 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a9cfb1fa-d0d0-45df-8a4d-329ffe613363 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:30.512273 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-a9cfb1fa-d0d0-45df-8a4d-329ffe613363 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:24:30.520848 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-a9cfb1fa-d0d0-45df-8a4d-329ffe613363 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.223913 Apr 30 13:24:30.521431 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 511/933] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:24:30 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:24:31.221660 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-cc163610-ae26-432f-9846-64e7c5d09572 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500bff670>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:31.313650 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-cc163610-ae26-432f-9846-64e7c5d09572 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.095622 Apr 30 13:24:31.314281 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 423/934] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:31 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:24:31.538972 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-f6c28928-ce47-47b7-83eb-bd32dc00ff3d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:31.539493 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-f6c28928-ce47-47b7-83eb-bd32dc00ff3d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:24:31.548013 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f6c28928-ce47-47b7-83eb-bd32dc00ff3d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:31.548471 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f6c28928-ce47-47b7-83eb-bd32dc00ff3d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:31.549259 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f6c28928-ce47-47b7-83eb-bd32dc00ff3d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:31.549705 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f6c28928-ce47-47b7-83eb-bd32dc00ff3d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:31.750165 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-f6c28928-ce47-47b7-83eb-bd32dc00ff3d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:24:31.758380 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-f6c28928-ce47-47b7-83eb-bd32dc00ff3d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.223513 Apr 30 13:24:31.758939 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 512/935] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:24:31 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:24:32.329992 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-a30be8bb-e2e9-411e-9a9a-348bde559100 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500b40280>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:32.423019 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-a30be8bb-e2e9-411e-9a9a-348bde559100 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.096528 Apr 30 13:24:32.423456 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 424/936] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:32 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:24:32.776305 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-c424097d-a35c-4544-9135-aa49f7b70eb5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:32.776935 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-c424097d-a35c-4544-9135-aa49f7b70eb5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:24:32.784769 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c424097d-a35c-4544-9135-aa49f7b70eb5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:32.785228 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c424097d-a35c-4544-9135-aa49f7b70eb5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:32.786311 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c424097d-a35c-4544-9135-aa49f7b70eb5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:32.786757 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c424097d-a35c-4544-9135-aa49f7b70eb5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:32.995322 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-c424097d-a35c-4544-9135-aa49f7b70eb5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:24:33.004224 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-c424097d-a35c-4544-9135-aa49f7b70eb5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.231872 Apr 30 13:24:33.004799 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 513/937] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:24:32 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:24:33.435402 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-22940e57-554e-4a1a-b1dd-7ab093a6089b tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500b40160>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:33.527085 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-22940e57-554e-4a1a-b1dd-7ab093a6089b tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.095545 Apr 30 13:24:33.527661 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 425/938] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:33 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:24:34.021480 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b81e5430-4480-4023-83e8-768313ba8d5b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:34.022115 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-b81e5430-4480-4023-83e8-768313ba8d5b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:24:34.029745 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b81e5430-4480-4023-83e8-768313ba8d5b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:34.030250 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b81e5430-4480-4023-83e8-768313ba8d5b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:34.031072 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b81e5430-4480-4023-83e8-768313ba8d5b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:34.031518 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b81e5430-4480-4023-83e8-768313ba8d5b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:34.229600 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-b81e5430-4480-4023-83e8-768313ba8d5b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:24:34.237883 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b81e5430-4480-4023-83e8-768313ba8d5b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.220176 Apr 30 13:24:34.238483 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 514/939] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:24:34 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:24:34.539175 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-b8b3e7d7-6877-4a60-ac45-32072565d186 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500bff430>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:34.631954 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-b8b3e7d7-6877-4a60-ac45-32072565d186 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.096838 Apr 30 13:24:34.632538 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 426/940] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:34 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:24:35.255479 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-01e3b953-513d-4d3d-a5d9-dcf0e80d981f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:35.256093 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-01e3b953-513d-4d3d-a5d9-dcf0e80d981f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:24:35.264353 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-01e3b953-513d-4d3d-a5d9-dcf0e80d981f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:35.264813 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-01e3b953-513d-4d3d-a5d9-dcf0e80d981f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:35.265610 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-01e3b953-513d-4d3d-a5d9-dcf0e80d981f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:35.266080 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-01e3b953-513d-4d3d-a5d9-dcf0e80d981f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:35.473087 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-01e3b953-513d-4d3d-a5d9-dcf0e80d981f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:24:35.481695 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-01e3b953-513d-4d3d-a5d9-dcf0e80d981f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.229971 Apr 30 13:24:35.482290 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 515/941] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:24:35 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:24:35.644436 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-ee85bfb2-13cf-4f12-8545-405d3ebd471d tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750024fdc0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:35.735526 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-ee85bfb2-13cf-4f12-8545-405d3ebd471d tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.094977 Apr 30 13:24:35.736110 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 427/942] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:35 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:24:36.499565 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-633b9abc-d4c9-419b-8975-1f10663d9b7f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:36.500191 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-633b9abc-d4c9-419b-8975-1f10663d9b7f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:24:36.507752 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-633b9abc-d4c9-419b-8975-1f10663d9b7f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:36.508210 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-633b9abc-d4c9-419b-8975-1f10663d9b7f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:36.509004 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-633b9abc-d4c9-419b-8975-1f10663d9b7f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:36.509452 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-633b9abc-d4c9-419b-8975-1f10663d9b7f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:36.737360 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-633b9abc-d4c9-419b-8975-1f10663d9b7f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:24:36.747880 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-a70d132c-0f30-4a75-9631-f90f33667d70 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750011fc10>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:36.758370 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-633b9abc-d4c9-419b-8975-1f10663d9b7f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.262449 Apr 30 13:24:36.758967 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 516/943] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:24:36 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:24:36.857880 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-a70d132c-0f30-4a75-9631-f90f33667d70 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.113687 Apr 30 13:24:36.863809 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 428/944] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:36 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:24:36.884389 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [req-9774027f-fb18-40c4-a26c-cb8f290e1789 req-84ab8525-0608-48f8-a05c-4c91da272ea1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d5ad250-b1c3-4849-9018-b9814f65927c", "name": "network-vif-unplugged", "status": "completed", "tag": "1ca6d999-b984-4833-8b8f-a6e9c0526e9e"}]} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:24:36.886295 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:24:36.886295 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: warnings.warn(msg) Apr 30 13:24:36.895188 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-9774027f-fb18-40c4-a26c-cb8f290e1789 req-84ab8525-0608-48f8-a05c-4c91da272ea1 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:36.895649 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-9774027f-fb18-40c4-a26c-cb8f290e1789 req-84ab8525-0608-48f8-a05c-4c91da272ea1 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:36.914841 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.compute.server_external_events [req-9774027f-fb18-40c4-a26c-cb8f290e1789 req-84ab8525-0608-48f8-a05c-4c91da272ea1 service nova] Creating event network-vif-unplugged:1ca6d999-b984-4833-8b8f-a6e9c0526e9e for instance 9d5ad250-b1c3-4849-9018-b9814f65927c on hv-cinder-78836 Apr 30 13:24:36.921104 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [req-9774027f-fb18-40c4-a26c-cb8f290e1789 req-84ab8525-0608-48f8-a05c-4c91da272ea1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042042 Apr 30 13:24:36.922030 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 517/945] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:24:36 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:24:37.778646 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-963792a0-3add-4674-a5ef-0f94c9dc4bcb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:37.779394 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-963792a0-3add-4674-a5ef-0f94c9dc4bcb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:24:37.787266 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-963792a0-3add-4674-a5ef-0f94c9dc4bcb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:37.787717 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-963792a0-3add-4674-a5ef-0f94c9dc4bcb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:37.788503 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-963792a0-3add-4674-a5ef-0f94c9dc4bcb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:37.788947 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-963792a0-3add-4674-a5ef-0f94c9dc4bcb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:37.871816 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-6c601f9f-3659-484f-b62b-41d9ccc332c8 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb7d6670>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:37.990328 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-6c601f9f-3659-484f-b62b-41d9ccc332c8 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.123376 Apr 30 13:24:37.990899 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 518/946] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:37 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:24:37.998944 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-963792a0-3add-4674-a5ef-0f94c9dc4bcb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:24:38.007655 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-963792a0-3add-4674-a5ef-0f94c9dc4bcb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.233006 Apr 30 13:24:38.008221 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 429/947] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:24:37 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:24:39.002860 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-f06afdf4-7943-4fe9-9411-32892506f0df tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750036f4c0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:39.027843 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-90e96d86-908c-4f8f-999a-6c74d6ac0b18 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:39.028598 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-90e96d86-908c-4f8f-999a-6c74d6ac0b18 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:24:39.036765 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-90e96d86-908c-4f8f-999a-6c74d6ac0b18 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:39.037231 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-90e96d86-908c-4f8f-999a-6c74d6ac0b18 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:39.038050 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-90e96d86-908c-4f8f-999a-6c74d6ac0b18 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:39.038507 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-90e96d86-908c-4f8f-999a-6c74d6ac0b18 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:39.106210 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-f06afdf4-7943-4fe9-9411-32892506f0df tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.106346 Apr 30 13:24:39.107397 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 519/948] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:38 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:24:39.242106 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-90e96d86-908c-4f8f-999a-6c74d6ac0b18 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:24:39.251633 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-90e96d86-908c-4f8f-999a-6c74d6ac0b18 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.229553 Apr 30 13:24:39.252123 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 430/949] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:24:39 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:24:40.119903 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-cffdc819-4ca0-4a57-a14a-3c06bd5442b8 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f75001610d0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:40.215699 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-cffdc819-4ca0-4a57-a14a-3c06bd5442b8 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.100141 Apr 30 13:24:40.216299 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 520/950] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:40 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:24:40.270884 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-cb79cc6a-eb69-4355-bc18-fd42e55c6ede tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:40.271532 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-cb79cc6a-eb69-4355-bc18-fd42e55c6ede tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:24:40.279616 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cb79cc6a-eb69-4355-bc18-fd42e55c6ede tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:40.280063 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cb79cc6a-eb69-4355-bc18-fd42e55c6ede tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:40.280848 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cb79cc6a-eb69-4355-bc18-fd42e55c6ede tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:40.281282 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cb79cc6a-eb69-4355-bc18-fd42e55c6ede tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:40.515973 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-cb79cc6a-eb69-4355-bc18-fd42e55c6ede tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:24:40.524858 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-cb79cc6a-eb69-4355-bc18-fd42e55c6ede tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.257614 Apr 30 13:24:40.525933 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 431/951] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:24:40 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:24:41.228213 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b67e3a4e-3e46-4768-ac92-8c539408dfad tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750022b040>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:41.320063 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b67e3a4e-3e46-4768-ac92-8c539408dfad tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.095598 Apr 30 13:24:41.320665 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 521/952] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:41 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:24:41.543057 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-4853f99f-63e3-4dbd-b5a7-d2f976e8f2aa tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:41.543679 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-4853f99f-63e3-4dbd-b5a7-d2f976e8f2aa tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:24:41.551027 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4853f99f-63e3-4dbd-b5a7-d2f976e8f2aa tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:41.551484 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4853f99f-63e3-4dbd-b5a7-d2f976e8f2aa tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:41.552276 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4853f99f-63e3-4dbd-b5a7-d2f976e8f2aa tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:41.552720 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4853f99f-63e3-4dbd-b5a7-d2f976e8f2aa tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:41.757959 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-4853f99f-63e3-4dbd-b5a7-d2f976e8f2aa tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:24:41.766962 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-4853f99f-63e3-4dbd-b5a7-d2f976e8f2aa tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.228059 Apr 30 13:24:41.767540 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 432/953] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:24:41 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:24:42.332635 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-0c386017-e217-4eda-adcd-25a58c6f88c6 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb7d13a0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:42.425284 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-0c386017-e217-4eda-adcd-25a58c6f88c6 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.096308 Apr 30 13:24:42.426323 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 522/954] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:42 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:24:42.784465 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-b503b070-10cf-4f25-833e-394e21c8ff78 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:42.785067 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-b503b070-10cf-4f25-833e-394e21c8ff78 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:24:42.793794 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b503b070-10cf-4f25-833e-394e21c8ff78 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:42.794386 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b503b070-10cf-4f25-833e-394e21c8ff78 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:42.795172 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b503b070-10cf-4f25-833e-394e21c8ff78 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:42.795610 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b503b070-10cf-4f25-833e-394e21c8ff78 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:42.996386 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-b503b070-10cf-4f25-833e-394e21c8ff78 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:24:43.005436 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-b503b070-10cf-4f25-833e-394e21c8ff78 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.224633 Apr 30 13:24:43.006024 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 433/955] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:24:42 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:24:43.438091 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-c2364052-d2c2-447c-ac6e-8a1076333edb tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb7d6670>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:43.538344 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-c2364052-d2c2-447c-ac6e-8a1076333edb tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.103978 Apr 30 13:24:43.539163 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 523/956] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:43 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:24:44.022894 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-7da4ed4f-382d-43ee-b157-3f62b37e2f32 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:44.023432 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-7da4ed4f-382d-43ee-b157-3f62b37e2f32 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:24:44.031655 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7da4ed4f-382d-43ee-b157-3f62b37e2f32 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:44.032106 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7da4ed4f-382d-43ee-b157-3f62b37e2f32 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:44.032897 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7da4ed4f-382d-43ee-b157-3f62b37e2f32 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:44.033335 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7da4ed4f-382d-43ee-b157-3f62b37e2f32 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:44.239205 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-7da4ed4f-382d-43ee-b157-3f62b37e2f32 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:24:44.248513 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-7da4ed4f-382d-43ee-b157-3f62b37e2f32 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.229487 Apr 30 13:24:44.249078 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 434/957] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:24:44 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:24:44.551382 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-37efc068-9697-4bc8-86fd-d9677c43ef1e tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb7d6790>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:44.643620 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-37efc068-9697-4bc8-86fd-d9677c43ef1e tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.096260 Apr 30 13:24:44.644291 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 524/958] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:44 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:24:45.266674 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-df530b03-415d-4358-9bd8-d14067209a29 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:45.267294 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-df530b03-415d-4358-9bd8-d14067209a29 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:24:45.274652 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-df530b03-415d-4358-9bd8-d14067209a29 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:45.275104 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-df530b03-415d-4358-9bd8-d14067209a29 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:45.276509 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-df530b03-415d-4358-9bd8-d14067209a29 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:45.276949 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-df530b03-415d-4358-9bd8-d14067209a29 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:45.478390 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-df530b03-415d-4358-9bd8-d14067209a29 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:24:45.487085 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-df530b03-415d-4358-9bd8-d14067209a29 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.224139 Apr 30 13:24:45.487835 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 435/959] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:24:45 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:24:45.655775 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-bfcf0a89-e98a-44fa-b497-ea1d9c2b742e tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb7d13a0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:45.748159 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-bfcf0a89-e98a-44fa-b497-ea1d9c2b742e tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.096104 Apr 30 13:24:45.748737 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 525/960] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:45 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:24:46.504710 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-d9b5ab4c-719f-418c-8a92-b1e1b5b2010d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:46.505324 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-d9b5ab4c-719f-418c-8a92-b1e1b5b2010d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:24:46.513110 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d9b5ab4c-719f-418c-8a92-b1e1b5b2010d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:46.513563 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d9b5ab4c-719f-418c-8a92-b1e1b5b2010d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:46.514373 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d9b5ab4c-719f-418c-8a92-b1e1b5b2010d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:46.514816 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d9b5ab4c-719f-418c-8a92-b1e1b5b2010d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:46.714653 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-d9b5ab4c-719f-418c-8a92-b1e1b5b2010d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:24:46.723215 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-d9b5ab4c-719f-418c-8a92-b1e1b5b2010d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.222174 Apr 30 13:24:46.723783 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 436/961] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:24:46 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:24:46.759728 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-39d6f1f4-665f-45a8-8b15-32059f80f784 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750022bca0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:46.860060 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-39d6f1f4-665f-45a8-8b15-32059f80f784 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.104245 Apr 30 13:24:46.864984 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 526/962] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:46 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:24:47.741038 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-81e29011-2a53-4ddd-ab22-280a280674d9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:47.741591 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-81e29011-2a53-4ddd-ab22-280a280674d9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:24:47.749281 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-81e29011-2a53-4ddd-ab22-280a280674d9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:47.749737 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-81e29011-2a53-4ddd-ab22-280a280674d9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:47.750566 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-81e29011-2a53-4ddd-ab22-280a280674d9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:47.751012 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-81e29011-2a53-4ddd-ab22-280a280674d9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:47.873153 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-cc12ea73-c968-443a-bad1-51b3afaf5c6e tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750022b280>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:47.962810 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-81e29011-2a53-4ddd-ab22-280a280674d9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:24:47.971293 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-cc12ea73-c968-443a-bad1-51b3afaf5c6e tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.102502 Apr 30 13:24:47.973450 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-81e29011-2a53-4ddd-ab22-280a280674d9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.236208 Apr 30 13:24:47.974044 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 437/963] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:24:47 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:24:47.976331 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 527/964] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:47 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:24:48.986209 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-f6628fe7-d87e-43b4-acdd-50307e134aa2 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500b404c0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:48.993140 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-9f17c161-c4c1-4574-842a-7ef25274a9e2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:48.995696 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-9f17c161-c4c1-4574-842a-7ef25274a9e2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:24:49.005192 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9f17c161-c4c1-4574-842a-7ef25274a9e2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:49.005718 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9f17c161-c4c1-4574-842a-7ef25274a9e2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:49.006577 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9f17c161-c4c1-4574-842a-7ef25274a9e2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:49.007024 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9f17c161-c4c1-4574-842a-7ef25274a9e2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:49.079089 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-f6628fe7-d87e-43b4-acdd-50307e134aa2 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.098168 Apr 30 13:24:49.080140 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 438/965] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:48 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:24:49.217822 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-9f17c161-c4c1-4574-842a-7ef25274a9e2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:24:49.226933 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-9f17c161-c4c1-4574-842a-7ef25274a9e2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.238110 Apr 30 13:24:49.227524 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 528/966] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:24:48 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:24:50.094197 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1abdcfbc-0fea-4857-8557-cdc275d2ef0c] AMQP server on 10.222.0.79:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 13:24:50.097624 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-5fb8885b-81c5-4068-b928-e2ff79ff1332 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750011fca0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:50.195640 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-5fb8885b-81c5-4068-b928-e2ff79ff1332 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.103433 Apr 30 13:24:50.196227 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 439/967] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:50 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:24:50.245192 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-4b33dc92-74bd-4292-9ce5-e97d6dcac421 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:50.245818 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-4b33dc92-74bd-4292-9ce5-e97d6dcac421 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:24:50.253479 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4b33dc92-74bd-4292-9ce5-e97d6dcac421 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:50.253932 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4b33dc92-74bd-4292-9ce5-e97d6dcac421 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:50.254869 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4b33dc92-74bd-4292-9ce5-e97d6dcac421 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:50.255308 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4b33dc92-74bd-4292-9ce5-e97d6dcac421 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:50.526495 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-4b33dc92-74bd-4292-9ce5-e97d6dcac421 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:24:50.534839 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-4b33dc92-74bd-4292-9ce5-e97d6dcac421 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.294121 Apr 30 13:24:50.535403 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 529/968] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:24:50 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:24:51.219386 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-3393b3fa-69b5-4262-8ef5-a1afda710569 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750015d430>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:51.232740 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO oslo.messaging._drivers.impl_rabbit [-] [1abdcfbc-0fea-4857-8557-cdc275d2ef0c] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 57174. Apr 30 13:24:51.312104 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-3393b3fa-69b5-4262-8ef5-a1afda710569 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.107949 Apr 30 13:24:51.312744 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 440/969] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:51 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:24:51.552634 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-3f7ec380-2ccf-4821-8d2d-de8ed2514302 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:51.553336 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-3f7ec380-2ccf-4821-8d2d-de8ed2514302 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:24:51.561815 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3f7ec380-2ccf-4821-8d2d-de8ed2514302 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:51.562301 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3f7ec380-2ccf-4821-8d2d-de8ed2514302 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:51.563084 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3f7ec380-2ccf-4821-8d2d-de8ed2514302 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:51.563522 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3f7ec380-2ccf-4821-8d2d-de8ed2514302 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:51.768550 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-3f7ec380-2ccf-4821-8d2d-de8ed2514302 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:24:51.777308 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-3f7ec380-2ccf-4821-8d2d-de8ed2514302 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.228382 Apr 30 13:24:51.777889 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 530/970] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:24:51 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:24:52.324793 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-accdaa2b-5f2f-46d2-9071-5a2d8f3b0368 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750015df70>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:52.416995 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-accdaa2b-5f2f-46d2-9071-5a2d8f3b0368 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.096051 Apr 30 13:24:52.417675 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 441/971] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:52 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:24:52.795223 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-af56b082-b4f3-4090-85ce-cc7558549df2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:52.796074 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-af56b082-b4f3-4090-85ce-cc7558549df2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:24:52.803608 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-af56b082-b4f3-4090-85ce-cc7558549df2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:52.804064 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-af56b082-b4f3-4090-85ce-cc7558549df2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:52.804856 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-af56b082-b4f3-4090-85ce-cc7558549df2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:52.805485 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-af56b082-b4f3-4090-85ce-cc7558549df2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:53.008491 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-af56b082-b4f3-4090-85ce-cc7558549df2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:24:53.017531 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-af56b082-b4f3-4090-85ce-cc7558549df2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.226167 Apr 30 13:24:53.018120 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 531/972] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:24:52 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:24:53.428654 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-cbd4c2d6-ab12-4106-ba28-302939e59d5a tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750011f040>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:53.529761 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-cbd4c2d6-ab12-4106-ba28-302939e59d5a tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.104756 Apr 30 13:24:53.534670 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 442/973] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:53 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:24:54.035675 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-3794b63f-d447-4086-9c6a-1f2d38c88466 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:54.036248 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-3794b63f-d447-4086-9c6a-1f2d38c88466 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:24:54.044510 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3794b63f-d447-4086-9c6a-1f2d38c88466 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:54.044968 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3794b63f-d447-4086-9c6a-1f2d38c88466 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:54.045814 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3794b63f-d447-4086-9c6a-1f2d38c88466 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:54.046278 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3794b63f-d447-4086-9c6a-1f2d38c88466 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:54.263708 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-3794b63f-d447-4086-9c6a-1f2d38c88466 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:24:54.272046 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-3794b63f-d447-4086-9c6a-1f2d38c88466 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.241693 Apr 30 13:24:54.272652 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 532/974] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:24:54 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:24:54.543040 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-732d4a79-3685-4848-95c6-e1e478c389da tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500b405e0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:54.641262 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-732d4a79-3685-4848-95c6-e1e478c389da tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.102490 Apr 30 13:24:54.641841 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 443/975] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:54 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:24:55.290017 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-449efb07-56f6-4544-8387-dd1c64e9e7d3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:55.291308 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-449efb07-56f6-4544-8387-dd1c64e9e7d3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:24:55.298670 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-449efb07-56f6-4544-8387-dd1c64e9e7d3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:55.299122 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-449efb07-56f6-4544-8387-dd1c64e9e7d3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:55.299896 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-449efb07-56f6-4544-8387-dd1c64e9e7d3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:55.300329 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-449efb07-56f6-4544-8387-dd1c64e9e7d3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:55.498514 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-449efb07-56f6-4544-8387-dd1c64e9e7d3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:24:55.506913 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-449efb07-56f6-4544-8387-dd1c64e9e7d3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.220615 Apr 30 13:24:55.507477 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 533/976] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:24:55 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:24:55.654517 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-cb259014-80e4-48b7-b13e-eefc456be75b tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500b40700>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:55.743740 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-cb259014-80e4-48b7-b13e-eefc456be75b tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.093653 Apr 30 13:24:55.744406 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 444/977] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:55 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:24:56.523871 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-ebf4a34f-5d33-4f63-8c81-e2dcfadef267 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:56.524483 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-ebf4a34f-5d33-4f63-8c81-e2dcfadef267 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:24:56.532593 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ebf4a34f-5d33-4f63-8c81-e2dcfadef267 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:56.533050 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ebf4a34f-5d33-4f63-8c81-e2dcfadef267 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:56.533835 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ebf4a34f-5d33-4f63-8c81-e2dcfadef267 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:56.534307 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ebf4a34f-5d33-4f63-8c81-e2dcfadef267 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:56.732696 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-ebf4a34f-5d33-4f63-8c81-e2dcfadef267 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:24:56.741003 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-ebf4a34f-5d33-4f63-8c81-e2dcfadef267 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.220876 Apr 30 13:24:56.741567 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 534/978] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:24:56 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:24:56.756000 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-afe5ea73-d876-448a-b605-e05f31dee4f8 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750011f430>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:56.848860 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-afe5ea73-d876-448a-b605-e05f31dee4f8 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.096433 Apr 30 13:24:56.849440 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 445/979] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:56 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:24:57.758282 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-8bc101ab-0f91-4a42-a41d-e007f379edec tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:57.758900 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-8bc101ab-0f91-4a42-a41d-e007f379edec tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:24:57.766818 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8bc101ab-0f91-4a42-a41d-e007f379edec tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:57.767276 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8bc101ab-0f91-4a42-a41d-e007f379edec tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:57.768062 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8bc101ab-0f91-4a42-a41d-e007f379edec tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:57.768506 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8bc101ab-0f91-4a42-a41d-e007f379edec tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:57.860611 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-81b35d50-d064-4043-b907-9aab0828829c tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750015d160>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:57.967648 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-81b35d50-d064-4043-b907-9aab0828829c tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.110666 Apr 30 13:24:57.968322 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 446/980] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:57 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:24:57.971877 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-8bc101ab-0f91-4a42-a41d-e007f379edec tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:24:57.980794 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-8bc101ab-0f91-4a42-a41d-e007f379edec tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.226265 Apr 30 13:24:57.981357 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 535/981] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:24:57 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:24:58.979644 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-7a8214de-c225-4931-ab6e-d1118cb989f0 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500bff280>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:59.001549 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-0ecfd11c-ed39-4780-b968-c9678208a7dc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:24:59.002198 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-0ecfd11c-ed39-4780-b968-c9678208a7dc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:24:59.010530 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0ecfd11c-ed39-4780-b968-c9678208a7dc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:59.010980 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0ecfd11c-ed39-4780-b968-c9678208a7dc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:59.011788 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0ecfd11c-ed39-4780-b968-c9678208a7dc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:24:59.012221 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0ecfd11c-ed39-4780-b968-c9678208a7dc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:24:59.074485 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-7a8214de-c225-4931-ab6e-d1118cb989f0 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.098573 Apr 30 13:24:59.075108 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 447/982] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:24:58 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:24:59.218447 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-0ecfd11c-ed39-4780-b968-c9678208a7dc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:24:59.226899 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-0ecfd11c-ed39-4780-b968-c9678208a7dc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.233632 Apr 30 13:24:59.227477 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 536/983] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:24:58 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:00.086884 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-688ea1c4-2b09-4291-8953-852373aacb28 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500bff310>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:00.177635 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-688ea1c4-2b09-4291-8953-852373aacb28 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.094366 Apr 30 13:25:00.178255 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 448/984] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:00 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:25:00.245456 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-20081092-ee64-4647-83f7-f064afb0a9c3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:00.246109 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-20081092-ee64-4647-83f7-f064afb0a9c3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:00.253555 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-20081092-ee64-4647-83f7-f064afb0a9c3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:00.254027 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-20081092-ee64-4647-83f7-f064afb0a9c3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:00.254869 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-20081092-ee64-4647-83f7-f064afb0a9c3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:00.255311 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-20081092-ee64-4647-83f7-f064afb0a9c3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:00.457321 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-20081092-ee64-4647-83f7-f064afb0a9c3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:00.466152 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-20081092-ee64-4647-83f7-f064afb0a9c3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.225276 Apr 30 13:25:00.466726 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 537/985] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:00 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:01.190890 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-0a0bb323-e2ac-42f2-a67a-20f75bb9f9db tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750015d1f0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:01.302059 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-0a0bb323-e2ac-42f2-a67a-20f75bb9f9db tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.114889 Apr 30 13:25:01.302641 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 449/986] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:01 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:25:01.483607 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-4d4d3176-cd7a-44a9-b9da-4d5e3914f215 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:01.484216 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-4d4d3176-cd7a-44a9-b9da-4d5e3914f215 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:01.499737 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4d4d3176-cd7a-44a9-b9da-4d5e3914f215 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:01.500166 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4d4d3176-cd7a-44a9-b9da-4d5e3914f215 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:01.500952 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4d4d3176-cd7a-44a9-b9da-4d5e3914f215 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:01.501457 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4d4d3176-cd7a-44a9-b9da-4d5e3914f215 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:01.703195 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-4d4d3176-cd7a-44a9-b9da-4d5e3914f215 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:01.711682 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-4d4d3176-cd7a-44a9-b9da-4d5e3914f215 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.231687 Apr 30 13:25:01.712237 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 538/987] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:01 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:02.314945 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-5b078279-5fdf-42a4-8d43-9c986064dc66 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500bbc9d0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:02.405226 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-5b078279-5fdf-42a4-8d43-9c986064dc66 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.093889 Apr 30 13:25:02.405802 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 450/988] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:02 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:25:02.729466 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-d2330bfc-4f5b-4611-9c0f-c07435b9261f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:02.730107 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-d2330bfc-4f5b-4611-9c0f-c07435b9261f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:02.737570 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d2330bfc-4f5b-4611-9c0f-c07435b9261f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:02.738050 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d2330bfc-4f5b-4611-9c0f-c07435b9261f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:02.738847 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d2330bfc-4f5b-4611-9c0f-c07435b9261f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:02.739288 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d2330bfc-4f5b-4611-9c0f-c07435b9261f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:02.941758 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-d2330bfc-4f5b-4611-9c0f-c07435b9261f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:02.950953 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-d2330bfc-4f5b-4611-9c0f-c07435b9261f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.225983 Apr 30 13:25:02.951521 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 539/989] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:02 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:03.418557 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-d3c1b1a5-388b-456f-a526-1605386a9719 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500b400d0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:03.513653 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-d3c1b1a5-388b-456f-a526-1605386a9719 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.098919 Apr 30 13:25:03.513653 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 451/990] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:03 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:25:03.976921 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-d47e7211-9cb4-4eb6-a331-78f01891f51c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:03.977573 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-d47e7211-9cb4-4eb6-a331-78f01891f51c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:03.985649 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d47e7211-9cb4-4eb6-a331-78f01891f51c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:03.986165 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d47e7211-9cb4-4eb6-a331-78f01891f51c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:03.986962 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d47e7211-9cb4-4eb6-a331-78f01891f51c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:03.987410 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d47e7211-9cb4-4eb6-a331-78f01891f51c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:04.194690 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-d47e7211-9cb4-4eb6-a331-78f01891f51c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:04.203997 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-d47e7211-9cb4-4eb6-a331-78f01891f51c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.231047 Apr 30 13:25:04.204562 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 540/991] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:03 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:25:04.525328 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-c2226d56-54a2-44ca-842a-4a81ec7495a5 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750011fca0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:04.622269 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-c2226d56-54a2-44ca-842a-4a81ec7495a5 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.100673 Apr 30 13:25:04.622844 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 452/992] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:04 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:25:05.220624 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-5176603c-e667-4721-ad66-29e1508c936d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:05.221260 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-5176603c-e667-4721-ad66-29e1508c936d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:05.228901 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5176603c-e667-4721-ad66-29e1508c936d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:05.229353 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5176603c-e667-4721-ad66-29e1508c936d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:05.230181 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5176603c-e667-4721-ad66-29e1508c936d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:05.230623 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5176603c-e667-4721-ad66-29e1508c936d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:05.437599 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-5176603c-e667-4721-ad66-29e1508c936d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:05.445946 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-5176603c-e667-4721-ad66-29e1508c936d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.229041 Apr 30 13:25:05.447280 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 541/993] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:05 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:05.634496 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-0b2626c1-a4e8-439a-b888-b81b5e8f78c9 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500bff790>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:05.725413 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-0b2626c1-a4e8-439a-b888-b81b5e8f78c9 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.094773 Apr 30 13:25:05.726455 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 453/994] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:05 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:25:06.464641 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-c52f78be-a2d8-4185-8714-7dd1ece09356 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:06.465260 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-c52f78be-a2d8-4185-8714-7dd1ece09356 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:06.473083 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c52f78be-a2d8-4185-8714-7dd1ece09356 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:06.473544 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c52f78be-a2d8-4185-8714-7dd1ece09356 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:06.474389 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c52f78be-a2d8-4185-8714-7dd1ece09356 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:06.474833 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c52f78be-a2d8-4185-8714-7dd1ece09356 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:06.675510 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-c52f78be-a2d8-4185-8714-7dd1ece09356 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:06.684263 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-c52f78be-a2d8-4185-8714-7dd1ece09356 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.223976 Apr 30 13:25:06.684830 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 542/995] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:06 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:06.738382 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-3ad250b7-6b99-4d94-889c-d93e012fc865 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750015d310>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:06.832745 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-3ad250b7-6b99-4d94-889c-d93e012fc865 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.098468 Apr 30 13:25:06.833472 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 454/996] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:06 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:25:07.701983 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-65baaf72-1497-4377-93aa-9e57b7759378 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:07.702632 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-65baaf72-1497-4377-93aa-9e57b7759378 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:07.710127 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-65baaf72-1497-4377-93aa-9e57b7759378 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:07.710580 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-65baaf72-1497-4377-93aa-9e57b7759378 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:07.711369 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-65baaf72-1497-4377-93aa-9e57b7759378 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:07.711805 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-65baaf72-1497-4377-93aa-9e57b7759378 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:07.846834 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-bbaf756e-45e9-4261-b85d-a42a590906b9 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750024ff70>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:07.918499 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-65baaf72-1497-4377-93aa-9e57b7759378 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:07.928004 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-65baaf72-1497-4377-93aa-9e57b7759378 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.229858 Apr 30 13:25:07.928581 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 543/997] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:07 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:07.947971 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-bbaf756e-45e9-4261-b85d-a42a590906b9 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.105660 Apr 30 13:25:07.948554 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 455/998] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:07 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:25:08.945614 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-edc54e7c-28af-42a8-8e77-fd5e492145fb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:08.946794 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-edc54e7c-28af-42a8-8e77-fd5e492145fb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:08.954261 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-edc54e7c-28af-42a8-8e77-fd5e492145fb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:08.954729 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-edc54e7c-28af-42a8-8e77-fd5e492145fb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:08.955952 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-edc54e7c-28af-42a8-8e77-fd5e492145fb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:08.956401 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-edc54e7c-28af-42a8-8e77-fd5e492145fb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:08.960711 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-7eac560c-b8ee-477a-88d0-10f67a61a082 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750015dd30>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:09.078101 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-7eac560c-b8ee-477a-88d0-10f67a61a082 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.120894 Apr 30 13:25:09.082833 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 456/999] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:08 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:25:09.168501 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-edc54e7c-28af-42a8-8e77-fd5e492145fb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:09.185468 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-edc54e7c-28af-42a8-8e77-fd5e492145fb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.243248 Apr 30 13:25:09.186550 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 544/1000] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:08 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:10.091025 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-19e3026d-4774-461c-bec7-eb4008236743 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500bbc670>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:10.181882 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-19e3026d-4774-461c-bec7-eb4008236743 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.095174 Apr 30 13:25:10.182499 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 457/1001] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:10 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:25:10.202987 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-65cbcd04-4f79-4591-95fc-a6479850e37f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:10.203670 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-65cbcd04-4f79-4591-95fc-a6479850e37f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:10.212853 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-65cbcd04-4f79-4591-95fc-a6479850e37f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:10.213305 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-65cbcd04-4f79-4591-95fc-a6479850e37f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:10.214156 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-65cbcd04-4f79-4591-95fc-a6479850e37f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:10.214606 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-65cbcd04-4f79-4591-95fc-a6479850e37f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:10.492902 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-65cbcd04-4f79-4591-95fc-a6479850e37f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:10.501379 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-65cbcd04-4f79-4591-95fc-a6479850e37f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.302076 Apr 30 13:25:10.501950 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 545/1002] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:10 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:11.194575 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-fb4d229c-6dbb-4419-995a-9e36e0ed5352 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500b40700>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:11.290440 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-fb4d229c-6dbb-4419-995a-9e36e0ed5352 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.099372 Apr 30 13:25:11.291018 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 458/1003] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:11 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:25:11.519243 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-0f4ac7c8-4c2f-4ce5-87ae-ce9a427100cd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:11.519862 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-0f4ac7c8-4c2f-4ce5-87ae-ce9a427100cd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:11.527498 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0f4ac7c8-4c2f-4ce5-87ae-ce9a427100cd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:11.527959 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0f4ac7c8-4c2f-4ce5-87ae-ce9a427100cd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:11.528745 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0f4ac7c8-4c2f-4ce5-87ae-ce9a427100cd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:11.529187 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0f4ac7c8-4c2f-4ce5-87ae-ce9a427100cd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:11.731600 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-0f4ac7c8-4c2f-4ce5-87ae-ce9a427100cd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:11.740027 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-0f4ac7c8-4c2f-4ce5-87ae-ce9a427100cd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.224521 Apr 30 13:25:11.740587 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 546/1004] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:11 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:12.302933 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-c35b8459-4788-43e6-9c3d-59849542cb3e tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500b40b80>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:12.394431 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-c35b8459-4788-43e6-9c3d-59849542cb3e tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.095119 Apr 30 13:25:12.395123 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 459/1005] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:12 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:25:12.756806 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-97ad5739-d6df-47fc-b34f-c80f11ab0fae tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:12.757415 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-97ad5739-d6df-47fc-b34f-c80f11ab0fae tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:12.764802 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-97ad5739-d6df-47fc-b34f-c80f11ab0fae tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:12.765258 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-97ad5739-d6df-47fc-b34f-c80f11ab0fae tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:12.766055 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-97ad5739-d6df-47fc-b34f-c80f11ab0fae tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:12.766496 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-97ad5739-d6df-47fc-b34f-c80f11ab0fae tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:12.968409 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-97ad5739-d6df-47fc-b34f-c80f11ab0fae tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:12.976814 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-97ad5739-d6df-47fc-b34f-c80f11ab0fae tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.223700 Apr 30 13:25:12.977886 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 547/1006] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:12 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:13.407164 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-ea5ac3c1-ede8-47b1-abd7-f3948c515eef tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750011f310>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:13.500398 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-ea5ac3c1-ede8-47b1-abd7-f3948c515eef tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.096700 Apr 30 13:25:13.501850 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 460/1007] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:13 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:25:13.995359 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-1780471a-1c20-4706-a81e-2d2f6d889231 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:13.995976 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-1780471a-1c20-4706-a81e-2d2f6d889231 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:14.003413 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1780471a-1c20-4706-a81e-2d2f6d889231 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:14.003873 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1780471a-1c20-4706-a81e-2d2f6d889231 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:14.004658 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1780471a-1c20-4706-a81e-2d2f6d889231 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:14.005107 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1780471a-1c20-4706-a81e-2d2f6d889231 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:14.207131 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-1780471a-1c20-4706-a81e-2d2f6d889231 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:14.215796 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-1780471a-1c20-4706-a81e-2d2f6d889231 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.224917 Apr 30 13:25:14.216361 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 548/1008] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:13 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:14.513701 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-c06e9ce6-6dca-4c01-bf8b-066c63b8e55a tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500bffaf0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:14.615288 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-c06e9ce6-6dca-4c01-bf8b-066c63b8e55a tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.105529 Apr 30 13:25:14.615883 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 461/1009] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:14 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:25:15.233410 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-01c7d216-d42c-4910-bdb6-5542e15b2cc4 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:15.234028 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-01c7d216-d42c-4910-bdb6-5542e15b2cc4 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:15.241367 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-01c7d216-d42c-4910-bdb6-5542e15b2cc4 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:15.241811 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-01c7d216-d42c-4910-bdb6-5542e15b2cc4 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:15.242608 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-01c7d216-d42c-4910-bdb6-5542e15b2cc4 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:15.243710 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-01c7d216-d42c-4910-bdb6-5542e15b2cc4 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:15.441693 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-01c7d216-d42c-4910-bdb6-5542e15b2cc4 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:15.450055 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-01c7d216-d42c-4910-bdb6-5542e15b2cc4 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.220453 Apr 30 13:25:15.450627 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 549/1010] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:15 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:15.627657 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-ca1d396d-0394-4360-a721-cb59920f4059 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750015dee0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:15.722119 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-ca1d396d-0394-4360-a721-cb59920f4059 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.097892 Apr 30 13:25:15.723116 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 462/1011] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:15 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:25:16.467500 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-a4758552-81ff-447f-bd51-012a4dfefc5e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:16.468884 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-a4758552-81ff-447f-bd51-012a4dfefc5e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:16.476612 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a4758552-81ff-447f-bd51-012a4dfefc5e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:16.477071 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a4758552-81ff-447f-bd51-012a4dfefc5e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:16.477906 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a4758552-81ff-447f-bd51-012a4dfefc5e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:16.478470 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a4758552-81ff-447f-bd51-012a4dfefc5e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:16.677582 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-a4758552-81ff-447f-bd51-012a4dfefc5e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:16.685877 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-a4758552-81ff-447f-bd51-012a4dfefc5e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.222089 Apr 30 13:25:16.686482 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 550/1012] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:16 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:25:16.738600 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-602c106f-69a4-4e90-bdf1-d5ffd785abd0 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750024f4c0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:16.835383 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-602c106f-69a4-4e90-bdf1-d5ffd785abd0 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.101196 Apr 30 13:25:16.840225 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 463/1013] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:16 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:25:17.703360 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-ba8cccf8-2793-4300-a04c-c552f88851d3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:17.703988 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-ba8cccf8-2793-4300-a04c-c552f88851d3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:17.711402 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ba8cccf8-2793-4300-a04c-c552f88851d3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:17.712187 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ba8cccf8-2793-4300-a04c-c552f88851d3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:17.712897 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ba8cccf8-2793-4300-a04c-c552f88851d3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:17.713344 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ba8cccf8-2793-4300-a04c-c552f88851d3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:17.847887 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-78616d69-ff79-4bfb-90bf-580c6b0dae43 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750015d700>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:17.919073 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-ba8cccf8-2793-4300-a04c-c552f88851d3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:17.927686 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-ba8cccf8-2793-4300-a04c-c552f88851d3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.228034 Apr 30 13:25:17.928259 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 551/1014] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:17 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:25:17.942576 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-78616d69-ff79-4bfb-90bf-580c6b0dae43 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.098466 Apr 30 13:25:17.943149 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 464/1015] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:17 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:25:18.944931 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-0afa6bad-9cea-4cec-9296-b04b0e5bf794 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:18.945533 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-0afa6bad-9cea-4cec-9296-b04b0e5bf794 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:18.954507 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0afa6bad-9cea-4cec-9296-b04b0e5bf794 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:18.955139 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0afa6bad-9cea-4cec-9296-b04b0e5bf794 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:18.955307 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-e8913099-4678-475d-9ab9-e16ec394b67f tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500bbc8b0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:18.956121 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0afa6bad-9cea-4cec-9296-b04b0e5bf794 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:18.956614 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0afa6bad-9cea-4cec-9296-b04b0e5bf794 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:19.050799 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-e8913099-4678-475d-9ab9-e16ec394b67f tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.099394 Apr 30 13:25:19.052745 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 465/1016] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:18 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:25:19.162721 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-0afa6bad-9cea-4cec-9296-b04b0e5bf794 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:19.171801 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-0afa6bad-9cea-4cec-9296-b04b0e5bf794 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.230663 Apr 30 13:25:19.172412 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 552/1017] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:18 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:20.063620 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-9b1bdbb2-84d2-4d2b-93ea-7574584221bc tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500b403a0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:20.154281 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-9b1bdbb2-84d2-4d2b-93ea-7574584221bc tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.094236 Apr 30 13:25:20.154860 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 466/1018] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:20 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:25:20.190999 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-81fdcf91-6513-47cc-94a1-b230e4b0ab44 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:20.191610 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-81fdcf91-6513-47cc-94a1-b230e4b0ab44 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:20.199571 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-81fdcf91-6513-47cc-94a1-b230e4b0ab44 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:20.200034 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-81fdcf91-6513-47cc-94a1-b230e4b0ab44 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:20.200828 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-81fdcf91-6513-47cc-94a1-b230e4b0ab44 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:20.201279 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-81fdcf91-6513-47cc-94a1-b230e4b0ab44 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:20.546902 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-81fdcf91-6513-47cc-94a1-b230e4b0ab44 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:20.555150 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-81fdcf91-6513-47cc-94a1-b230e4b0ab44 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.367977 Apr 30 13:25:20.556403 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 553/1019] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:20 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:25:21.167320 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-553997e7-c4d3-4884-9985-ca3792ff97b6 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500b40280>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:21.263857 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-553997e7-c4d3-4884-9985-ca3792ff97b6 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.100963 Apr 30 13:25:21.264541 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 467/1020] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:21 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:25:21.572760 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-e6025649-2706-4994-9ab7-49170bd00c0c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:21.573382 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-e6025649-2706-4994-9ab7-49170bd00c0c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:21.580838 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e6025649-2706-4994-9ab7-49170bd00c0c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:21.581394 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e6025649-2706-4994-9ab7-49170bd00c0c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:21.582223 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e6025649-2706-4994-9ab7-49170bd00c0c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:21.582666 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e6025649-2706-4994-9ab7-49170bd00c0c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:21.780895 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-e6025649-2706-4994-9ab7-49170bd00c0c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:21.789727 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-e6025649-2706-4994-9ab7-49170bd00c0c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.220638 Apr 30 13:25:21.790634 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 554/1021] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:21 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:22.276624 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-8f921ed6-5181-4ea3-914e-d6756ead90bb tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750011f9d0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:22.366740 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-8f921ed6-5181-4ea3-914e-d6756ead90bb tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.094059 Apr 30 13:25:22.367320 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 468/1022] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:22 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:25:22.807459 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-8f861767-be10-4b35-ae36-811964950ecb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:22.807993 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-8f861767-be10-4b35-ae36-811964950ecb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:22.816126 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8f861767-be10-4b35-ae36-811964950ecb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:22.816489 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8f861767-be10-4b35-ae36-811964950ecb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:22.817296 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8f861767-be10-4b35-ae36-811964950ecb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:22.817742 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8f861767-be10-4b35-ae36-811964950ecb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:23.053664 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-8f861767-be10-4b35-ae36-811964950ecb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:23.063167 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-8f861767-be10-4b35-ae36-811964950ecb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.260087 Apr 30 13:25:23.063661 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 555/1023] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:22 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:23.380025 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-a42b0625-7908-4fc3-87b9-17420bef9197 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500bff940>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:23.475429 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-a42b0625-7908-4fc3-87b9-17420bef9197 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.099069 Apr 30 13:25:23.475998 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 469/1024] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:23 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:25:24.080243 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-0a69dad7-7eb9-44c0-b529-915aed9c907b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:24.081113 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-0a69dad7-7eb9-44c0-b529-915aed9c907b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:24.088658 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0a69dad7-7eb9-44c0-b529-915aed9c907b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:24.089116 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0a69dad7-7eb9-44c0-b529-915aed9c907b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:24.089905 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0a69dad7-7eb9-44c0-b529-915aed9c907b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:24.090382 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0a69dad7-7eb9-44c0-b529-915aed9c907b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:24.290769 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-0a69dad7-7eb9-44c0-b529-915aed9c907b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:24.299257 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-0a69dad7-7eb9-44c0-b529-915aed9c907b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.222771 Apr 30 13:25:24.299823 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 556/1025] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:24 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:24.488108 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-bcb029e2-cf1f-4fa8-935b-006134f48eeb tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750015dc10>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:24.583331 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-bcb029e2-cf1f-4fa8-935b-006134f48eeb tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.098871 Apr 30 13:25:24.583900 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 470/1026] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:24 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:25:25.317090 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-59eb6265-1962-42ba-9a0b-f783f0382144 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:25.317702 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-59eb6265-1962-42ba-9a0b-f783f0382144 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:25.325940 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-59eb6265-1962-42ba-9a0b-f783f0382144 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:25.326420 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-59eb6265-1962-42ba-9a0b-f783f0382144 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:25.327205 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-59eb6265-1962-42ba-9a0b-f783f0382144 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:25.327644 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-59eb6265-1962-42ba-9a0b-f783f0382144 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:25.529213 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-59eb6265-1962-42ba-9a0b-f783f0382144 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:25.538304 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-59eb6265-1962-42ba-9a0b-f783f0382144 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.224893 Apr 30 13:25:25.538889 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 557/1027] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:25 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:25.596510 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-6c8df82a-7916-48eb-b1a5-7e310b19bdb6 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750024f9d0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:25.694379 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-6c8df82a-7916-48eb-b1a5-7e310b19bdb6 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.101558 Apr 30 13:25:25.695106 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 471/1028] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:25 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:25:26.557357 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-54e458ba-1df0-450d-b19a-e0063b27a9be tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:26.557970 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-54e458ba-1df0-450d-b19a-e0063b27a9be tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:26.565499 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-54e458ba-1df0-450d-b19a-e0063b27a9be tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:26.565944 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-54e458ba-1df0-450d-b19a-e0063b27a9be tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:26.566787 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-54e458ba-1df0-450d-b19a-e0063b27a9be tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:26.567222 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-54e458ba-1df0-450d-b19a-e0063b27a9be tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:26.706401 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-a50deafb-d482-4c3f-b60c-6b45e0112b0b tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750015d700>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:26.775001 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-54e458ba-1df0-450d-b19a-e0063b27a9be tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:26.783414 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-54e458ba-1df0-450d-b19a-e0063b27a9be tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.230537 Apr 30 13:25:26.783989 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 558/1029] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:26 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:26.803396 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-a50deafb-d482-4c3f-b60c-6b45e0112b0b tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.101212 Apr 30 13:25:26.803977 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 472/1030] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:26 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:25:27.815467 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-ec3a6909-88d4-452c-b4ff-575a04d37b98 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500bbc8b0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:27.919739 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-ec3a6909-88d4-452c-b4ff-575a04d37b98 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.107434 Apr 30 13:25:27.920715 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 473/1031] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:27 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:25:27.931015 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-30c4fab1-1075-4ff7-a2bd-74caae4d179d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:27.932333 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-30c4fab1-1075-4ff7-a2bd-74caae4d179d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:27.944961 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-30c4fab1-1075-4ff7-a2bd-74caae4d179d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:27.945784 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-30c4fab1-1075-4ff7-a2bd-74caae4d179d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:27.947447 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-30c4fab1-1075-4ff7-a2bd-74caae4d179d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:27.948201 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-30c4fab1-1075-4ff7-a2bd-74caae4d179d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:28.175422 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-30c4fab1-1075-4ff7-a2bd-74caae4d179d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:28.183782 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-30c4fab1-1075-4ff7-a2bd-74caae4d179d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.386948 Apr 30 13:25:28.184348 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 559/1032] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:27 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:28.940027 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-1133bf7c-a1d1-4497-ab4d-c57217d85d61 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750011fdc0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:29.033249 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-1133bf7c-a1d1-4497-ab4d-c57217d85d61 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.099369 Apr 30 13:25:29.033826 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 474/1033] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:28 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:25:29.201070 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-1fa38acb-17ef-493b-9c89-c6cd37374553 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:29.201673 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-1fa38acb-17ef-493b-9c89-c6cd37374553 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:29.209200 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1fa38acb-17ef-493b-9c89-c6cd37374553 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:29.209491 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1fa38acb-17ef-493b-9c89-c6cd37374553 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:29.210303 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1fa38acb-17ef-493b-9c89-c6cd37374553 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:29.210739 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1fa38acb-17ef-493b-9c89-c6cd37374553 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:29.422563 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-1fa38acb-17ef-493b-9c89-c6cd37374553 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:29.432108 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-1fa38acb-17ef-493b-9c89-c6cd37374553 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.235093 Apr 30 13:25:29.432676 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 560/1034] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:29 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:30.046138 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-1fc093e9-df8f-49f2-ac3c-7d184638a594 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500bff940>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:30.136874 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-1fc093e9-df8f-49f2-ac3c-7d184638a594 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.094345 Apr 30 13:25:30.137559 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 475/1035] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:30 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:25:30.449747 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-0a2e21f5-273d-40a9-a4c9-7b8b4227e0a5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:30.450380 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-0a2e21f5-273d-40a9-a4c9-7b8b4227e0a5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:30.457884 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0a2e21f5-273d-40a9-a4c9-7b8b4227e0a5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:30.458362 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0a2e21f5-273d-40a9-a4c9-7b8b4227e0a5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:30.459138 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0a2e21f5-273d-40a9-a4c9-7b8b4227e0a5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:30.459573 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0a2e21f5-273d-40a9-a4c9-7b8b4227e0a5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:30.662282 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-0a2e21f5-273d-40a9-a4c9-7b8b4227e0a5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:30.671411 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-0a2e21f5-273d-40a9-a4c9-7b8b4227e0a5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.226039 Apr 30 13:25:30.671984 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 561/1036] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:30 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:31.150940 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-b360b31f-2224-4e51-a7ed-a29cb4260714 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750015d4c0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:31.274236 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-b360b31f-2224-4e51-a7ed-a29cb4260714 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.127438 Apr 30 13:25:31.275319 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 476/1037] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:31 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:25:31.689159 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-6fff0f9c-c3c8-4c42-9dad-e0a2c7d20a6c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:31.689770 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-6fff0f9c-c3c8-4c42-9dad-e0a2c7d20a6c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:31.697905 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6fff0f9c-c3c8-4c42-9dad-e0a2c7d20a6c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:31.698380 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6fff0f9c-c3c8-4c42-9dad-e0a2c7d20a6c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:31.699164 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6fff0f9c-c3c8-4c42-9dad-e0a2c7d20a6c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:31.699601 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6fff0f9c-c3c8-4c42-9dad-e0a2c7d20a6c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:31.961479 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-6fff0f9c-c3c8-4c42-9dad-e0a2c7d20a6c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:31.969783 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-6fff0f9c-c3c8-4c42-9dad-e0a2c7d20a6c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.284316 Apr 30 13:25:31.970374 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 562/1038] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:31 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:32.287564 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-a6d79238-8057-4679-bed6-e54047d5de61 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500b40ee0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:32.385006 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-a6d79238-8057-4679-bed6-e54047d5de61 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.101501 Apr 30 13:25:32.385678 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 477/1039] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:32 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:25:32.988771 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-55f34d83-35ad-4cc5-9997-c253125c9dcf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:32.989547 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-55f34d83-35ad-4cc5-9997-c253125c9dcf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:32.997956 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-55f34d83-35ad-4cc5-9997-c253125c9dcf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:32.998476 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-55f34d83-35ad-4cc5-9997-c253125c9dcf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:32.999266 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-55f34d83-35ad-4cc5-9997-c253125c9dcf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:32.999713 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-55f34d83-35ad-4cc5-9997-c253125c9dcf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:33.213689 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-55f34d83-35ad-4cc5-9997-c253125c9dcf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:33.222336 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-55f34d83-35ad-4cc5-9997-c253125c9dcf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.238163 Apr 30 13:25:33.222911 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 563/1040] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:32 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:25:33.398068 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-5d3f7fc9-cb79-4182-92a4-2e94672e8e3f tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500b40820>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:33.494540 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-5d3f7fc9-cb79-4182-92a4-2e94672e8e3f tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.100051 Apr 30 13:25:33.500124 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 478/1041] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:33 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:25:34.240898 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b8cc5e13-6a77-4552-8b28-ee6b777a074e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:34.241512 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-b8cc5e13-6a77-4552-8b28-ee6b777a074e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:34.249930 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b8cc5e13-6a77-4552-8b28-ee6b777a074e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:34.250502 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b8cc5e13-6a77-4552-8b28-ee6b777a074e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:34.251306 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b8cc5e13-6a77-4552-8b28-ee6b777a074e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:34.251752 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b8cc5e13-6a77-4552-8b28-ee6b777a074e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:34.461054 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-b8cc5e13-6a77-4552-8b28-ee6b777a074e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:34.470610 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b8cc5e13-6a77-4552-8b28-ee6b777a074e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.233380 Apr 30 13:25:34.471530 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 564/1042] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:34 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:34.507984 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-f316a6a1-2961-476e-b31b-da35ca3366b3 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750015d040>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:34.604630 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-f316a6a1-2961-476e-b31b-da35ca3366b3 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.100116 Apr 30 13:25:34.605477 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 479/1043] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:34 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:25:35.494435 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-913ed5a2-7bb8-4b29-bcfe-829131a44fd0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:35.495050 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-913ed5a2-7bb8-4b29-bcfe-829131a44fd0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:35.502523 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-913ed5a2-7bb8-4b29-bcfe-829131a44fd0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:35.502980 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-913ed5a2-7bb8-4b29-bcfe-829131a44fd0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:35.503776 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-913ed5a2-7bb8-4b29-bcfe-829131a44fd0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:35.504222 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-913ed5a2-7bb8-4b29-bcfe-829131a44fd0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:35.625040 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-5091d84c-98b2-414c-ab16-ee115c6558b1 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750015d700>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:35.709446 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-913ed5a2-7bb8-4b29-bcfe-829131a44fd0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:35.720760 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-913ed5a2-7bb8-4b29-bcfe-829131a44fd0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.230113 Apr 30 13:25:35.721394 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 565/1044] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:35 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:35.729163 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-5091d84c-98b2-414c-ab16-ee115c6558b1 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.112072 Apr 30 13:25:35.729939 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 480/1045] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:35 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:25:36.744288 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-5ed0b511-7e6e-4761-bd09-44e5d3fb01da tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500bad0d0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:36.748850 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-ccd9628e-7b80-4492-bdae-729154ae9054 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:36.749916 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-ccd9628e-7b80-4492-bdae-729154ae9054 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:36.761794 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ccd9628e-7b80-4492-bdae-729154ae9054 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:36.762466 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ccd9628e-7b80-4492-bdae-729154ae9054 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:36.763328 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ccd9628e-7b80-4492-bdae-729154ae9054 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:36.765021 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ccd9628e-7b80-4492-bdae-729154ae9054 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:36.852353 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-5ed0b511-7e6e-4761-bd09-44e5d3fb01da tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.112971 Apr 30 13:25:36.853463 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 566/1046] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:36 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:25:36.985656 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-ccd9628e-7b80-4492-bdae-729154ae9054 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:36.994582 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-ccd9628e-7b80-4492-bdae-729154ae9054 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.252528 Apr 30 13:25:36.995081 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 481/1047] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:36 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:37.868343 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-461d8774-c3c0-4087-853b-ac30546dc3fd tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500c6fd30>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:37.970745 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-461d8774-c3c0-4087-853b-ac30546dc3fd tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.108904 Apr 30 13:25:37.971419 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 567/1048] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:37 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:25:38.017986 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-05eda507-cdbd-4d40-b094-fba4dc509288 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:38.018997 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-05eda507-cdbd-4d40-b094-fba4dc509288 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:38.027051 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-05eda507-cdbd-4d40-b094-fba4dc509288 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:38.027529 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-05eda507-cdbd-4d40-b094-fba4dc509288 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:38.028311 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-05eda507-cdbd-4d40-b094-fba4dc509288 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:38.028750 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-05eda507-cdbd-4d40-b094-fba4dc509288 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:38.244635 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-05eda507-cdbd-4d40-b094-fba4dc509288 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:38.253369 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-05eda507-cdbd-4d40-b094-fba4dc509288 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.239529 Apr 30 13:25:38.254225 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 482/1049] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:38 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:38.983354 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-a8945085-3fea-432b-a023-b7d30d701b30 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb7d6280>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:39.103541 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-a8945085-3fea-432b-a023-b7d30d701b30 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.123828 Apr 30 13:25:39.104268 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 568/1050] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:38 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:25:39.275387 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-6ea96825-770a-40f9-9c49-91a28170c5b7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:39.276113 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-6ea96825-770a-40f9-9c49-91a28170c5b7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:39.286465 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6ea96825-770a-40f9-9c49-91a28170c5b7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:39.287251 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6ea96825-770a-40f9-9c49-91a28170c5b7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:39.288616 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6ea96825-770a-40f9-9c49-91a28170c5b7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:39.289889 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6ea96825-770a-40f9-9c49-91a28170c5b7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:39.519077 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-6ea96825-770a-40f9-9c49-91a28170c5b7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:39.527707 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-6ea96825-770a-40f9-9c49-91a28170c5b7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.257275 Apr 30 13:25:39.528274 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 483/1051] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:39 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:40.115934 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-2822f488-bf9a-4b03-bc6d-784fa89834a4 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb738dc0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:40.207715 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-2822f488-bf9a-4b03-bc6d-784fa89834a4 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.095412 Apr 30 13:25:40.208357 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 569/1052] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:40 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:25:40.551167 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-3f999e34-6218-489c-82ed-703ad0d38935 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:40.551812 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-3f999e34-6218-489c-82ed-703ad0d38935 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:40.560319 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3f999e34-6218-489c-82ed-703ad0d38935 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:40.560768 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3f999e34-6218-489c-82ed-703ad0d38935 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:40.561543 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3f999e34-6218-489c-82ed-703ad0d38935 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:40.561985 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3f999e34-6218-489c-82ed-703ad0d38935 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:40.766097 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-3f999e34-6218-489c-82ed-703ad0d38935 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:40.774383 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-3f999e34-6218-489c-82ed-703ad0d38935 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.226860 Apr 30 13:25:40.774946 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 484/1053] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:40 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:41.220017 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-ac5c6c6c-6825-4031-ae64-46fc0ef14190 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500bad160>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:41.314795 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-ac5c6c6c-6825-4031-ae64-46fc0ef14190 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.098131 Apr 30 13:25:41.315151 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 570/1054] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:41 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:25:41.792377 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-798a7114-f92e-4c03-9cce-5c134514ad96 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:41.792923 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-798a7114-f92e-4c03-9cce-5c134514ad96 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:41.800702 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-798a7114-f92e-4c03-9cce-5c134514ad96 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:41.801158 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-798a7114-f92e-4c03-9cce-5c134514ad96 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:41.801988 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-798a7114-f92e-4c03-9cce-5c134514ad96 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:41.802461 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-798a7114-f92e-4c03-9cce-5c134514ad96 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:42.057583 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-798a7114-f92e-4c03-9cce-5c134514ad96 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:42.065902 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-798a7114-f92e-4c03-9cce-5c134514ad96 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.277646 Apr 30 13:25:42.066496 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 485/1055] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:41 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:42.326888 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-bd1296bf-0266-4912-b02d-d841a36f839c tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500080c10>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:42.420681 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-bd1296bf-0266-4912-b02d-d841a36f839c tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.097194 Apr 30 13:25:42.421754 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 571/1056] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:42 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:25:43.083633 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-ff5f7b89-0a23-4fb4-9415-8d6d9560a814 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:43.084254 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-ff5f7b89-0a23-4fb4-9415-8d6d9560a814 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:43.091971 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ff5f7b89-0a23-4fb4-9415-8d6d9560a814 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:43.092429 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ff5f7b89-0a23-4fb4-9415-8d6d9560a814 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:43.093223 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ff5f7b89-0a23-4fb4-9415-8d6d9560a814 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:43.093673 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ff5f7b89-0a23-4fb4-9415-8d6d9560a814 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:43.309297 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-ff5f7b89-0a23-4fb4-9415-8d6d9560a814 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:43.319823 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-ff5f7b89-0a23-4fb4-9415-8d6d9560a814 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.239949 Apr 30 13:25:43.321050 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 486/1057] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:43 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:43.436783 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-f85e3b96-17cd-474b-a615-e1d7ad7109e7 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500ce78b0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:43.547047 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-f85e3b96-17cd-474b-a615-e1d7ad7109e7 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.117345 Apr 30 13:25:43.547648 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 572/1058] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:43 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:25:44.338824 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-45aeb572-8257-4694-b28c-b7767d87678e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:44.339441 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-45aeb572-8257-4694-b28c-b7767d87678e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:44.346933 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-45aeb572-8257-4694-b28c-b7767d87678e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:44.347384 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-45aeb572-8257-4694-b28c-b7767d87678e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:44.348160 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-45aeb572-8257-4694-b28c-b7767d87678e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:44.348597 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-45aeb572-8257-4694-b28c-b7767d87678e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:44.553825 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-45aeb572-8257-4694-b28c-b7767d87678e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:44.560867 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-c9912e38-5573-4331-b614-5e9edff370d5 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500bad9d0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:44.563064 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-45aeb572-8257-4694-b28c-b7767d87678e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.228500 Apr 30 13:25:44.563898 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 487/1059] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:44 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:44.657909 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-c9912e38-5573-4331-b614-5e9edff370d5 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.100317 Apr 30 13:25:44.658982 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 573/1060] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:44 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:25:45.580514 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-c2778257-5a7d-4e17-93b1-3db82430b645 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:45.581134 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-c2778257-5a7d-4e17-93b1-3db82430b645 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:45.589205 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c2778257-5a7d-4e17-93b1-3db82430b645 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:45.589652 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c2778257-5a7d-4e17-93b1-3db82430b645 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:45.590466 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c2778257-5a7d-4e17-93b1-3db82430b645 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:45.590904 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c2778257-5a7d-4e17-93b1-3db82430b645 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:45.671003 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-63622c01-b6a3-4792-8237-e04db5b13596 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500c6f160>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:45.766847 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-63622c01-b6a3-4792-8237-e04db5b13596 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.099025 Apr 30 13:25:45.767576 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 574/1061] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:45 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:25:45.818690 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-c2778257-5a7d-4e17-93b1-3db82430b645 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:45.833377 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-c2778257-5a7d-4e17-93b1-3db82430b645 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.256214 Apr 30 13:25:45.834585 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 488/1062] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:45 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:25:46.779974 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-7f8591bf-71af-40fb-be1d-bf7eaa132d75 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb7384c0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:46.858197 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-120603c8-7acd-4fcd-ad3f-70c67a65157e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:46.859785 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-120603c8-7acd-4fcd-ad3f-70c67a65157e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:46.871139 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-120603c8-7acd-4fcd-ad3f-70c67a65157e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:46.872628 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-120603c8-7acd-4fcd-ad3f-70c67a65157e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:46.873760 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-120603c8-7acd-4fcd-ad3f-70c67a65157e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:46.874627 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-120603c8-7acd-4fcd-ad3f-70c67a65157e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:46.946156 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-7f8591bf-71af-40fb-be1d-bf7eaa132d75 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.169350 Apr 30 13:25:46.947052 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 575/1063] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:46 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:25:47.136203 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-120603c8-7acd-4fcd-ad3f-70c67a65157e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:47.144745 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-120603c8-7acd-4fcd-ad3f-70c67a65157e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.290908 Apr 30 13:25:47.155987 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 489/1064] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:46 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:47.965588 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-c6cfad72-8de7-4f60-90f9-7b703b372bdc tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500bad8b0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:48.070390 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-c6cfad72-8de7-4f60-90f9-7b703b372bdc tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.111531 Apr 30 13:25:48.071043 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 576/1065] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:47 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:25:48.165342 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-36313d4c-12d5-475e-bd6f-eab8044716e3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:48.166490 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-36313d4c-12d5-475e-bd6f-eab8044716e3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:48.173948 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-36313d4c-12d5-475e-bd6f-eab8044716e3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:48.174496 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-36313d4c-12d5-475e-bd6f-eab8044716e3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:48.175323 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-36313d4c-12d5-475e-bd6f-eab8044716e3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:48.175801 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-36313d4c-12d5-475e-bd6f-eab8044716e3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:48.448984 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-36313d4c-12d5-475e-bd6f-eab8044716e3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:48.457462 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-36313d4c-12d5-475e-bd6f-eab8044716e3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.297475 Apr 30 13:25:48.458201 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 490/1066] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:48 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:49.083088 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-867f3514-cdc2-4706-9b8a-b3c6ce8d35bf tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500080a60>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:49.179909 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-867f3514-cdc2-4706-9b8a-b3c6ce8d35bf tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.099609 Apr 30 13:25:49.181091 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 577/1067] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:49 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:25:49.477864 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-aa261282-f460-47e1-9f43-790c311da528 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:49.478799 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-aa261282-f460-47e1-9f43-790c311da528 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:49.488169 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-aa261282-f460-47e1-9f43-790c311da528 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:49.489016 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-aa261282-f460-47e1-9f43-790c311da528 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:49.490481 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-aa261282-f460-47e1-9f43-790c311da528 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:49.491392 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-aa261282-f460-47e1-9f43-790c311da528 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:49.701243 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-aa261282-f460-47e1-9f43-790c311da528 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:49.710058 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-aa261282-f460-47e1-9f43-790c311da528 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.237482 Apr 30 13:25:49.710880 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 491/1068] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:49 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:50.195969 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-f4e4e5ff-d420-4c34-961e-0ebf1a7d45cb tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500146b80>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:50.295699 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-f4e4e5ff-d420-4c34-961e-0ebf1a7d45cb tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.104040 Apr 30 13:25:50.296335 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 578/1069] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:50 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:25:50.727992 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-da589685-b465-4d36-a910-de10337b99bd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:50.728590 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-da589685-b465-4d36-a910-de10337b99bd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:50.736178 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-da589685-b465-4d36-a910-de10337b99bd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:50.736635 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-da589685-b465-4d36-a910-de10337b99bd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:50.737431 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-da589685-b465-4d36-a910-de10337b99bd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:50.737876 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-da589685-b465-4d36-a910-de10337b99bd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:50.946592 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-da589685-b465-4d36-a910-de10337b99bd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:50.955270 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-da589685-b465-4d36-a910-de10337b99bd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.231225 Apr 30 13:25:50.955851 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 492/1070] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:50 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:51.309525 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-c5e8060b-74e0-4648-b81b-63e1de4c6816 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500bade50>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:51.407991 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-c5e8060b-74e0-4648-b81b-63e1de4c6816 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.102088 Apr 30 13:25:51.408722 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 579/1071] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:51 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:25:51.973004 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-f1bec146-19ac-46e0-9cc5-dedac17340ab tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:51.973819 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-f1bec146-19ac-46e0-9cc5-dedac17340ab tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:51.982056 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f1bec146-19ac-46e0-9cc5-dedac17340ab tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:51.982517 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f1bec146-19ac-46e0-9cc5-dedac17340ab tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:51.983311 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f1bec146-19ac-46e0-9cc5-dedac17340ab tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:51.983774 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f1bec146-19ac-46e0-9cc5-dedac17340ab tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:52.220289 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-f1bec146-19ac-46e0-9cc5-dedac17340ab tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:52.229627 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-f1bec146-19ac-46e0-9cc5-dedac17340ab tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.260972 Apr 30 13:25:52.230236 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 493/1072] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:51 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:52.421228 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-a7804463-3dba-462a-a856-cd8522c775b2 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb738430>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:52.519159 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-a7804463-3dba-462a-a856-cd8522c775b2 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.101706 Apr 30 13:25:52.524894 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 580/1073] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:52 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:25:53.252658 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-741e5536-f473-4c78-b206-d7b834e7928b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:53.253859 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-741e5536-f473-4c78-b206-d7b834e7928b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:53.262598 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-741e5536-f473-4c78-b206-d7b834e7928b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:53.263189 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-741e5536-f473-4c78-b206-d7b834e7928b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:53.264311 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-741e5536-f473-4c78-b206-d7b834e7928b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:53.264852 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-741e5536-f473-4c78-b206-d7b834e7928b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:53.534655 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-43835318-d5e8-4e73-8389-9ff6d4387089 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb738ca0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:53.640594 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-43835318-d5e8-4e73-8389-9ff6d4387089 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.111365 Apr 30 13:25:53.641464 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 581/1074] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:53 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:25:53.708651 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-741e5536-f473-4c78-b206-d7b834e7928b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:53.723748 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-741e5536-f473-4c78-b206-d7b834e7928b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.474618 Apr 30 13:25:53.724904 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 494/1075] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:53 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:54.655955 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-8b815cf2-2454-4814-81f1-ce6dcf0c4f54 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500bad8b0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:54.750839 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-f8392c12-1e72-45e3-a4f2-bd28eb4d125d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:54.751809 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-f8392c12-1e72-45e3-a4f2-bd28eb4d125d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:54.754060 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-8b815cf2-2454-4814-81f1-ce6dcf0c4f54 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.102068 Apr 30 13:25:54.754632 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 582/1076] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:54 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:25:54.764047 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f8392c12-1e72-45e3-a4f2-bd28eb4d125d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:54.764732 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f8392c12-1e72-45e3-a4f2-bd28eb4d125d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:54.765935 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f8392c12-1e72-45e3-a4f2-bd28eb4d125d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:54.766644 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f8392c12-1e72-45e3-a4f2-bd28eb4d125d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:55.037642 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-f8392c12-1e72-45e3-a4f2-bd28eb4d125d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:55.046745 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-f8392c12-1e72-45e3-a4f2-bd28eb4d125d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.302037 Apr 30 13:25:55.047314 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 495/1077] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:54 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:25:55.768209 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-4006ca32-d0ff-4d86-be0a-e59f67cec617 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500080d30>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:55.910976 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-4006ca32-d0ff-4d86-be0a-e59f67cec617 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.146232 Apr 30 13:25:55.911548 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 583/1078] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:55 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:25:56.064977 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-309cf33a-f3e4-4bd5-ab48-b85fa5592de9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:56.065723 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-309cf33a-f3e4-4bd5-ab48-b85fa5592de9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:56.073867 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-309cf33a-f3e4-4bd5-ab48-b85fa5592de9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:56.074466 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-309cf33a-f3e4-4bd5-ab48-b85fa5592de9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:56.075296 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-309cf33a-f3e4-4bd5-ab48-b85fa5592de9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:56.075790 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-309cf33a-f3e4-4bd5-ab48-b85fa5592de9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:56.333747 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-309cf33a-f3e4-4bd5-ab48-b85fa5592de9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:56.346653 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-309cf33a-f3e4-4bd5-ab48-b85fa5592de9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.285656 Apr 30 13:25:56.347555 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 496/1079] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:56 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:56.926424 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-d623cc65-8421-46ad-89d5-6cef380b7677 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f75001460d0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:57.028306 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-d623cc65-8421-46ad-89d5-6cef380b7677 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.105787 Apr 30 13:25:57.029092 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 584/1080] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:56 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:25:57.368544 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-eac9d637-df30-42b2-b1eb-40f74d56bab1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:57.370031 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-eac9d637-df30-42b2-b1eb-40f74d56bab1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:57.381548 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-eac9d637-df30-42b2-b1eb-40f74d56bab1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:57.382085 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-eac9d637-df30-42b2-b1eb-40f74d56bab1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:57.383820 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-eac9d637-df30-42b2-b1eb-40f74d56bab1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:57.384313 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-eac9d637-df30-42b2-b1eb-40f74d56bab1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:57.622100 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-eac9d637-df30-42b2-b1eb-40f74d56bab1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:57.631175 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-eac9d637-df30-42b2-b1eb-40f74d56bab1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.269816 Apr 30 13:25:57.631815 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 497/1081] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:57 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:58.041869 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-672a4fb5-abf1-420d-9cee-3e7e7aa2a48c tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500bad9d0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:58.193289 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-672a4fb5-abf1-420d-9cee-3e7e7aa2a48c tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.155705 Apr 30 13:25:58.194575 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 585/1082] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:58 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:25:58.649784 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-cccd6972-6c91-4c13-9392-8bfa85602279 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:58.650449 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-cccd6972-6c91-4c13-9392-8bfa85602279 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:58.658275 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cccd6972-6c91-4c13-9392-8bfa85602279 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:58.658730 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cccd6972-6c91-4c13-9392-8bfa85602279 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:58.659520 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cccd6972-6c91-4c13-9392-8bfa85602279 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:58.659963 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cccd6972-6c91-4c13-9392-8bfa85602279 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:58.904874 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-cccd6972-6c91-4c13-9392-8bfa85602279 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:25:58.920510 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-cccd6972-6c91-4c13-9392-8bfa85602279 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.275054 Apr 30 13:25:58.921549 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 498/1083] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:58 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:25:59.208505 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-284713ad-52b3-4705-9bd6-ac24e7c73bd2 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb738e50>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:59.306701 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-284713ad-52b3-4705-9bd6-ac24e7c73bd2 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.101526 Apr 30 13:25:59.307663 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 586/1084] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:25:59 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:25:59.939151 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-12c89108-ad44-4c9f-a54a-42ce9905de39 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:25:59.939771 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-12c89108-ad44-4c9f-a54a-42ce9905de39 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:25:59.948341 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-12c89108-ad44-4c9f-a54a-42ce9905de39 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:59.948837 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-12c89108-ad44-4c9f-a54a-42ce9905de39 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:25:59.949668 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-12c89108-ad44-4c9f-a54a-42ce9905de39 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:25:59.950184 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-12c89108-ad44-4c9f-a54a-42ce9905de39 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:00.162400 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-12c89108-ad44-4c9f-a54a-42ce9905de39 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:26:00.171638 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-12c89108-ad44-4c9f-a54a-42ce9905de39 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.236500 Apr 30 13:26:00.172292 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 499/1085] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:25:59 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:26:00.321916 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-bf2cdb17-bd77-47b7-b37f-0e8617381207 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb7388b0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:00.419144 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-bf2cdb17-bd77-47b7-b37f-0e8617381207 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.101661 Apr 30 13:26:00.419816 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 587/1086] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:00 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:26:01.189511 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-547187e9-5f10-4c38-96fc-a86637c00647 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:01.190159 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-547187e9-5f10-4c38-96fc-a86637c00647 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:26:01.198553 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-547187e9-5f10-4c38-96fc-a86637c00647 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:01.199012 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-547187e9-5f10-4c38-96fc-a86637c00647 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:01.199806 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-547187e9-5f10-4c38-96fc-a86637c00647 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:01.200250 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-547187e9-5f10-4c38-96fc-a86637c00647 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:01.403665 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-547187e9-5f10-4c38-96fc-a86637c00647 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:26:01.412461 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-547187e9-5f10-4c38-96fc-a86637c00647 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.226656 Apr 30 13:26:01.413042 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 500/1087] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:26:01 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:26:01.433106 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-366ba555-975c-4345-bb6c-7656fbac1bcf tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500bad160>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:01.528933 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-366ba555-975c-4345-bb6c-7656fbac1bcf tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.100316 Apr 30 13:26:01.529504 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 588/1088] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:01 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:26:02.430759 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-0586ab5d-f77b-4453-b094-943f2e7e463f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:02.431385 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-0586ab5d-f77b-4453-b094-943f2e7e463f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:26:02.438908 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0586ab5d-f77b-4453-b094-943f2e7e463f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:02.439360 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0586ab5d-f77b-4453-b094-943f2e7e463f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:02.440153 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0586ab5d-f77b-4453-b094-943f2e7e463f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:02.440595 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0586ab5d-f77b-4453-b094-943f2e7e463f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:02.542481 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-7d6c23e7-e5c3-4399-bf93-3d3eaf4e132b tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500146b80>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:02.641935 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-7d6c23e7-e5c3-4399-bf93-3d3eaf4e132b tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.103621 Apr 30 13:26:02.642953 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 589/1089] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:02 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:26:02.645435 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-0586ab5d-f77b-4453-b094-943f2e7e463f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:26:02.654443 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-0586ab5d-f77b-4453-b094-943f2e7e463f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.228211 Apr 30 13:26:02.655031 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 501/1090] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:26:02 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:26:03.655575 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-2358fbb5-255e-4a6c-8273-b1ba88e5f547 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500146670>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:03.671649 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-280fdbe9-3a57-42be-832c-8edcc7d0db11 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:03.672355 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-280fdbe9-3a57-42be-832c-8edcc7d0db11 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:26:03.681617 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-280fdbe9-3a57-42be-832c-8edcc7d0db11 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:03.682104 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-280fdbe9-3a57-42be-832c-8edcc7d0db11 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:03.682898 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-280fdbe9-3a57-42be-832c-8edcc7d0db11 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:03.683331 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-280fdbe9-3a57-42be-832c-8edcc7d0db11 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:03.753834 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-2358fbb5-255e-4a6c-8273-b1ba88e5f547 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.101616 Apr 30 13:26:03.755810 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 590/1091] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:03 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:26:03.894472 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-280fdbe9-3a57-42be-832c-8edcc7d0db11 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:26:03.904964 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-280fdbe9-3a57-42be-832c-8edcc7d0db11 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.236776 Apr 30 13:26:03.916908 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 502/1092] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:26:03 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:26:04.770183 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-79021f86-c59e-44c1-b282-ea7f56dfcbf3 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb738280>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:04.865785 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-79021f86-c59e-44c1-b282-ea7f56dfcbf3 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.099252 Apr 30 13:26:04.866474 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 591/1093] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:04 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:26:04.924090 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-e75c034b-f87f-43d5-b066-94bd20804dfe tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:04.924708 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-e75c034b-f87f-43d5-b066-94bd20804dfe tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:26:04.932054 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e75c034b-f87f-43d5-b066-94bd20804dfe tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:04.932539 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e75c034b-f87f-43d5-b066-94bd20804dfe tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:04.933321 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e75c034b-f87f-43d5-b066-94bd20804dfe tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:04.933763 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e75c034b-f87f-43d5-b066-94bd20804dfe tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:05.146173 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-e75c034b-f87f-43d5-b066-94bd20804dfe tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:26:05.155148 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-e75c034b-f87f-43d5-b066-94bd20804dfe tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.234817 Apr 30 13:26:05.155815 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 503/1094] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:26:04 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:26:05.878401 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-23ead850-db06-4670-a5ae-bf3005c08a23 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f75000803a0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:05.971456 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-23ead850-db06-4670-a5ae-bf3005c08a23 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.096700 Apr 30 13:26:05.972030 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 592/1095] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:05 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:26:06.172473 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-35a7340a-285b-46ab-b5f2-a2c737966a1b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:06.173094 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-35a7340a-285b-46ab-b5f2-a2c737966a1b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:26:06.181474 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-35a7340a-285b-46ab-b5f2-a2c737966a1b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:06.181936 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-35a7340a-285b-46ab-b5f2-a2c737966a1b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:06.182778 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-35a7340a-285b-46ab-b5f2-a2c737966a1b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:06.183228 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-35a7340a-285b-46ab-b5f2-a2c737966a1b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:06.386133 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-35a7340a-285b-46ab-b5f2-a2c737966a1b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:26:06.394622 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-35a7340a-285b-46ab-b5f2-a2c737966a1b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.225893 Apr 30 13:26:06.395127 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 504/1096] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:26:06 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:26:06.984377 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-28fe4eb5-8d14-4b95-933f-967b1b5e28da tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500080280>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:07.076592 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-28fe4eb5-8d14-4b95-933f-967b1b5e28da tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.095783 Apr 30 13:26:07.077243 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 593/1097] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:06 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:26:07.412111 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-0e50060e-0f95-4e8b-962a-f0946428dc3a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:07.412631 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-0e50060e-0f95-4e8b-962a-f0946428dc3a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:26:07.420160 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0e50060e-0f95-4e8b-962a-f0946428dc3a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:07.420618 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0e50060e-0f95-4e8b-962a-f0946428dc3a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:07.421408 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0e50060e-0f95-4e8b-962a-f0946428dc3a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:07.421900 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0e50060e-0f95-4e8b-962a-f0946428dc3a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:07.624423 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-0e50060e-0f95-4e8b-962a-f0946428dc3a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:26:07.633960 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-0e50060e-0f95-4e8b-962a-f0946428dc3a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.225948 Apr 30 13:26:07.634587 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 505/1098] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:26:07 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:26:08.090977 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-6162acda-28f6-453e-a4b5-f88c9122a7c8 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb738ee0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:08.186846 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-6162acda-28f6-453e-a4b5-f88c9122a7c8 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.100812 Apr 30 13:26:08.187493 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 594/1099] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:08 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:26:08.651958 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-f7d00217-0d9a-49b2-82d5-9e0476d36fd0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:08.652578 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-f7d00217-0d9a-49b2-82d5-9e0476d36fd0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:26:08.659989 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f7d00217-0d9a-49b2-82d5-9e0476d36fd0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:08.660386 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f7d00217-0d9a-49b2-82d5-9e0476d36fd0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:08.661426 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f7d00217-0d9a-49b2-82d5-9e0476d36fd0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:08.661869 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f7d00217-0d9a-49b2-82d5-9e0476d36fd0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:08.996807 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-f7d00217-0d9a-49b2-82d5-9e0476d36fd0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:26:09.005448 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-f7d00217-0d9a-49b2-82d5-9e0476d36fd0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.357957 Apr 30 13:26:09.006048 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 506/1100] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:26:08 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:26:09.200284 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-38a289dd-f289-42ac-89b8-b20e37a4f445 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500badc10>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:09.294786 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-38a289dd-f289-42ac-89b8-b20e37a4f445 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.098281 Apr 30 13:26:09.295359 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 595/1101] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:09 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:26:10.024560 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-954b6262-091d-4aeb-99a8-d2ebda9d70cb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:10.025280 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-954b6262-091d-4aeb-99a8-d2ebda9d70cb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:26:10.032572 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-954b6262-091d-4aeb-99a8-d2ebda9d70cb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:10.033021 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-954b6262-091d-4aeb-99a8-d2ebda9d70cb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:10.033802 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-954b6262-091d-4aeb-99a8-d2ebda9d70cb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:10.034269 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-954b6262-091d-4aeb-99a8-d2ebda9d70cb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:10.233979 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-954b6262-091d-4aeb-99a8-d2ebda9d70cb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:26:10.242510 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-954b6262-091d-4aeb-99a8-d2ebda9d70cb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.222499 Apr 30 13:26:10.243085 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 507/1102] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:26:10 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:26:10.307180 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-7e199f86-41db-4c9d-8111-92c16690d418 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500146940>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:10.396599 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-7e199f86-41db-4c9d-8111-92c16690d418 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.093172 Apr 30 13:26:10.397178 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 596/1103] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:10 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:26:11.259851 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-e04adea7-c88c-451f-9e4f-b30bdacc38ca tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:11.260518 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-e04adea7-c88c-451f-9e4f-b30bdacc38ca tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:26:11.267963 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e04adea7-c88c-451f-9e4f-b30bdacc38ca tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:11.268406 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e04adea7-c88c-451f-9e4f-b30bdacc38ca tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:11.269179 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e04adea7-c88c-451f-9e4f-b30bdacc38ca tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:11.269612 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e04adea7-c88c-451f-9e4f-b30bdacc38ca tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:11.409794 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b42c03ce-4a8c-4a62-9daa-00d6388534ee tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb738e50>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:11.471030 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-e04adea7-c88c-451f-9e4f-b30bdacc38ca tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:26:11.480973 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-e04adea7-c88c-451f-9e4f-b30bdacc38ca tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.225048 Apr 30 13:26:11.483083 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 508/1104] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:26:11 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:26:11.506961 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b42c03ce-4a8c-4a62-9daa-00d6388534ee tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.100780 Apr 30 13:26:11.507596 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 597/1105] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:11 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:26:12.498447 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-aad7fa22-0ae9-40b8-99b4-d6d0c53da3fc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:12.499071 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-aad7fa22-0ae9-40b8-99b4-d6d0c53da3fc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:26:12.507948 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-aad7fa22-0ae9-40b8-99b4-d6d0c53da3fc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:12.508472 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-aad7fa22-0ae9-40b8-99b4-d6d0c53da3fc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:12.509285 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-aad7fa22-0ae9-40b8-99b4-d6d0c53da3fc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:12.509738 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-aad7fa22-0ae9-40b8-99b4-d6d0c53da3fc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:12.520654 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-1faf3697-dc63-4904-82ee-b575e5a9f33f tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500080c10>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:12.629333 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-1faf3697-dc63-4904-82ee-b575e5a9f33f tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.113296 Apr 30 13:26:12.630099 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 598/1106] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:12 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:26:12.722034 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-aad7fa22-0ae9-40b8-99b4-d6d0c53da3fc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:26:12.731487 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-aad7fa22-0ae9-40b8-99b4-d6d0c53da3fc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.236705 Apr 30 13:26:12.732142 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 509/1107] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:26:12 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:26:13.643306 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-585f25da-c55e-4252-887f-d2b9bb5f0277 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500080790>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:13.737261 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-585f25da-c55e-4252-887f-d2b9bb5f0277 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.097349 Apr 30 13:26:13.738531 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 599/1108] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:13 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:26:13.749201 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-5d76f805-6999-43c2-ade8-1832e93a9691 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:13.750855 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-5d76f805-6999-43c2-ade8-1832e93a9691 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:26:13.762605 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5d76f805-6999-43c2-ade8-1832e93a9691 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:13.763494 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5d76f805-6999-43c2-ade8-1832e93a9691 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:13.764981 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5d76f805-6999-43c2-ade8-1832e93a9691 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:13.765862 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5d76f805-6999-43c2-ade8-1832e93a9691 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:13.985807 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-5d76f805-6999-43c2-ade8-1832e93a9691 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:26:14.001875 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-5d76f805-6999-43c2-ade8-1832e93a9691 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.256441 Apr 30 13:26:14.002932 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 510/1109] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:26:13 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:26:14.750784 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-85bd7e95-bd9d-4b72-a161-ed87803ae517 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb738ee0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:14.847128 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-85bd7e95-bd9d-4b72-a161-ed87803ae517 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.100035 Apr 30 13:26:14.847910 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 600/1110] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:14 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:26:15.027087 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-d982d5f1-e285-4b70-aded-62abb02e146b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:15.027633 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-d982d5f1-e285-4b70-aded-62abb02e146b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:26:15.035062 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d982d5f1-e285-4b70-aded-62abb02e146b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:15.035777 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d982d5f1-e285-4b70-aded-62abb02e146b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:15.036568 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d982d5f1-e285-4b70-aded-62abb02e146b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:15.037009 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d982d5f1-e285-4b70-aded-62abb02e146b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:15.249736 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-d982d5f1-e285-4b70-aded-62abb02e146b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:26:15.258436 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-d982d5f1-e285-4b70-aded-62abb02e146b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.235931 Apr 30 13:26:15.259020 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 511/1111] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:26:15 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:26:15.860091 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-6c13b6dc-e68b-4aa1-bd86-9a0d443eedb9 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500bad1f0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:15.955703 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-6c13b6dc-e68b-4aa1-bd86-9a0d443eedb9 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.099351 Apr 30 13:26:15.956399 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 601/1112] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:15 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:26:16.275328 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-e662bc74-00ff-4d35-a578-6b50c8761029 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:16.275939 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-e662bc74-00ff-4d35-a578-6b50c8761029 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:26:16.283400 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e662bc74-00ff-4d35-a578-6b50c8761029 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:16.283852 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e662bc74-00ff-4d35-a578-6b50c8761029 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:16.284629 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e662bc74-00ff-4d35-a578-6b50c8761029 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:16.285067 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e662bc74-00ff-4d35-a578-6b50c8761029 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:16.491140 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-e662bc74-00ff-4d35-a578-6b50c8761029 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:26:16.500485 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-e662bc74-00ff-4d35-a578-6b50c8761029 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.228866 Apr 30 13:26:16.501068 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 512/1113] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:26:16 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:26:16.968374 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-a061b101-1197-4e2b-a0ea-8ef8b85e5d5e tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb7d6d30>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:17.057784 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-a061b101-1197-4e2b-a0ea-8ef8b85e5d5e tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.093017 Apr 30 13:26:17.058396 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 602/1114] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:16 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:26:17.519766 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-51e79ac8-2ebe-43e4-804b-353b75d2454f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:17.520380 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-51e79ac8-2ebe-43e4-804b-353b75d2454f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:26:17.528597 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-51e79ac8-2ebe-43e4-804b-353b75d2454f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:17.529043 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-51e79ac8-2ebe-43e4-804b-353b75d2454f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:17.529876 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-51e79ac8-2ebe-43e4-804b-353b75d2454f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:17.530524 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-51e79ac8-2ebe-43e4-804b-353b75d2454f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:17.732149 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-51e79ac8-2ebe-43e4-804b-353b75d2454f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:26:17.741131 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-51e79ac8-2ebe-43e4-804b-353b75d2454f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.225051 Apr 30 13:26:17.741825 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 513/1115] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:26:17 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:26:18.112487 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-33ca0267-cbc0-447c-ba16-5e5ff576c3ce tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb7d6310>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:18.203580 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-33ca0267-cbc0-447c-ba16-5e5ff576c3ce tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.137713 Apr 30 13:26:18.204155 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 603/1116] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:18 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:26:18.758574 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-129aa6b4-359c-496c-83ce-3447a0828875 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:18.759191 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-129aa6b4-359c-496c-83ce-3447a0828875 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:26:18.767073 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-129aa6b4-359c-496c-83ce-3447a0828875 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:18.767517 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-129aa6b4-359c-496c-83ce-3447a0828875 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:18.768310 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-129aa6b4-359c-496c-83ce-3447a0828875 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:18.768758 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-129aa6b4-359c-496c-83ce-3447a0828875 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:18.969434 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-129aa6b4-359c-496c-83ce-3447a0828875 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:26:18.979093 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-129aa6b4-359c-496c-83ce-3447a0828875 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.224606 Apr 30 13:26:18.979671 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 514/1117] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:26:18 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:26:19.218631 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-4655fd5d-de55-49de-bc86-83f702af617c tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f75001460d0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:19.312159 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-4655fd5d-de55-49de-bc86-83f702af617c tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.097175 Apr 30 13:26:19.312815 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 604/1118] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:19 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:26:19.996995 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-acb355c6-2c23-4034-ae83-83c36af12ae9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:19.997595 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-acb355c6-2c23-4034-ae83-83c36af12ae9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:26:20.005719 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-acb355c6-2c23-4034-ae83-83c36af12ae9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:20.006200 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-acb355c6-2c23-4034-ae83-83c36af12ae9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:20.007035 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-acb355c6-2c23-4034-ae83-83c36af12ae9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:20.007523 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-acb355c6-2c23-4034-ae83-83c36af12ae9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:20.219127 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-acb355c6-2c23-4034-ae83-83c36af12ae9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:26:20.228833 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-acb355c6-2c23-4034-ae83-83c36af12ae9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.235602 Apr 30 13:26:20.229408 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 515/1119] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:26:19 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:26:20.324600 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-8beb942f-c6bd-488d-8ce6-c26604ffea0d tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb738e50>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:20.418110 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-8beb942f-c6bd-488d-8ce6-c26604ffea0d tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.097111 Apr 30 13:26:20.418752 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 605/1120] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:20 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:26:21.246755 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-430e760f-5187-4300-ae5b-caf1818cdd78 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:21.247406 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-430e760f-5187-4300-ae5b-caf1818cdd78 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:26:21.254840 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-430e760f-5187-4300-ae5b-caf1818cdd78 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:21.255294 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-430e760f-5187-4300-ae5b-caf1818cdd78 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:21.256085 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-430e760f-5187-4300-ae5b-caf1818cdd78 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:21.257182 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-430e760f-5187-4300-ae5b-caf1818cdd78 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:21.431644 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-42df86db-af2a-4cc3-9f8a-be1710b75e08 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500080310>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:21.458655 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-430e760f-5187-4300-ae5b-caf1818cdd78 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:26:21.467247 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-430e760f-5187-4300-ae5b-caf1818cdd78 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.224434 Apr 30 13:26:21.467875 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 516/1121] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:26:21 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:26:21.524296 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-42df86db-af2a-4cc3-9f8a-be1710b75e08 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.097101 Apr 30 13:26:21.524867 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 606/1122] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:21 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:26:22.484879 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-cf619132-f001-436a-af0f-254086e8f33c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:22.485494 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-cf619132-f001-436a-af0f-254086e8f33c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:26:22.492935 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cf619132-f001-436a-af0f-254086e8f33c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:22.493382 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cf619132-f001-436a-af0f-254086e8f33c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:22.494189 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cf619132-f001-436a-af0f-254086e8f33c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:22.494629 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cf619132-f001-436a-af0f-254086e8f33c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:22.535958 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-6ff85a63-5d32-423a-9bed-84a0d6dfc876 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500080ca0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:22.631558 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-6ff85a63-5d32-423a-9bed-84a0d6dfc876 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.099487 Apr 30 13:26:22.632140 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 607/1123] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:22 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:26:22.701329 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-cf619132-f001-436a-af0f-254086e8f33c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:26:22.710275 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-cf619132-f001-436a-af0f-254086e8f33c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.228468 Apr 30 13:26:22.711332 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 517/1124] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:26:22 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:26:23.644409 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-758a46ac-fe06-47fd-84d7-15a3161abe1e tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb738430>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:23.729740 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-35ea4c3c-42d0-4e73-a844-a87b78913b5e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:23.730451 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-35ea4c3c-42d0-4e73-a844-a87b78913b5e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:26:23.737782 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-35ea4c3c-42d0-4e73-a844-a87b78913b5e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:23.738264 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-35ea4c3c-42d0-4e73-a844-a87b78913b5e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:23.739068 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-35ea4c3c-42d0-4e73-a844-a87b78913b5e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:23.739498 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-35ea4c3c-42d0-4e73-a844-a87b78913b5e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:23.747529 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-758a46ac-fe06-47fd-84d7-15a3161abe1e tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.106821 Apr 30 13:26:23.749086 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 608/1125] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:23 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:26:23.977699 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-35ea4c3c-42d0-4e73-a844-a87b78913b5e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:26:23.986503 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-35ea4c3c-42d0-4e73-a844-a87b78913b5e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.261117 Apr 30 13:26:23.987307 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 518/1126] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:26:23 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:26:24.761198 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-ae9637cb-6077-4fd9-a235-7357fe6afdcd tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500badd30>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:24.857886 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-ae9637cb-6077-4fd9-a235-7357fe6afdcd tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.101187 Apr 30 13:26:24.858773 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 609/1127] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:24 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:26:25.003916 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-53bdc17a-23e7-4120-a946-7b31b374f1b5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:25.004537 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-53bdc17a-23e7-4120-a946-7b31b374f1b5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:26:25.012724 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-53bdc17a-23e7-4120-a946-7b31b374f1b5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:25.013114 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-53bdc17a-23e7-4120-a946-7b31b374f1b5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:25.013919 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-53bdc17a-23e7-4120-a946-7b31b374f1b5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:25.014403 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-53bdc17a-23e7-4120-a946-7b31b374f1b5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:25.217429 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-53bdc17a-23e7-4120-a946-7b31b374f1b5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:26:25.226143 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-53bdc17a-23e7-4120-a946-7b31b374f1b5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.225765 Apr 30 13:26:25.226717 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 519/1128] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:26:24 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:26:25.871045 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-87501b15-9460-4b0e-9349-96352bd18104 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb7d6160>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:25.965341 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-87501b15-9460-4b0e-9349-96352bd18104 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.097923 Apr 30 13:26:25.965919 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 610/1129] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:25 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:26:26.243134 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-88f15792-5e1a-41c3-8c16-a011030dde7e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:26.243748 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-88f15792-5e1a-41c3-8c16-a011030dde7e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:26:26.251090 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-88f15792-5e1a-41c3-8c16-a011030dde7e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:26.251504 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-88f15792-5e1a-41c3-8c16-a011030dde7e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:26.252283 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-88f15792-5e1a-41c3-8c16-a011030dde7e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:26.252721 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-88f15792-5e1a-41c3-8c16-a011030dde7e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:26.452949 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-88f15792-5e1a-41c3-8c16-a011030dde7e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:26:26.462167 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-88f15792-5e1a-41c3-8c16-a011030dde7e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.222948 Apr 30 13:26:26.462738 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 520/1130] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:26:26 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:26:26.978726 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-ac29b6c4-2def-40e0-8c33-c9ff07f29c72 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb7d6280>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:27.076344 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-ac29b6c4-2def-40e0-8c33-c9ff07f29c72 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.102202 Apr 30 13:26:27.076917 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 611/1131] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:26 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:26:27.479979 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-930622d4-e5bd-4689-a71f-82e4da7b256f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:27.480669 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-930622d4-e5bd-4689-a71f-82e4da7b256f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:26:27.489397 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-930622d4-e5bd-4689-a71f-82e4da7b256f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:27.489857 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-930622d4-e5bd-4689-a71f-82e4da7b256f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:27.490806 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-930622d4-e5bd-4689-a71f-82e4da7b256f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:27.491258 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-930622d4-e5bd-4689-a71f-82e4da7b256f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:27.699861 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-930622d4-e5bd-4689-a71f-82e4da7b256f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:26:27.708167 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-930622d4-e5bd-4689-a71f-82e4da7b256f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.232707 Apr 30 13:26:27.708727 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 521/1132] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:26:27 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:26:28.088210 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-1b01c695-74c5-4908-afe5-8a6369a9a43f tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500146160>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:28.179574 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-1b01c695-74c5-4908-afe5-8a6369a9a43f tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.095378 Apr 30 13:26:28.180158 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 612/1133] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:28 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:26:28.725932 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-4db1bfe5-b607-4d30-ad04-3c75e7d32344 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:28.726583 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-4db1bfe5-b607-4d30-ad04-3c75e7d32344 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:26:28.733953 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4db1bfe5-b607-4d30-ad04-3c75e7d32344 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:28.734538 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4db1bfe5-b607-4d30-ad04-3c75e7d32344 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:28.735316 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4db1bfe5-b607-4d30-ad04-3c75e7d32344 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:28.735763 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4db1bfe5-b607-4d30-ad04-3c75e7d32344 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:29.023099 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-4db1bfe5-b607-4d30-ad04-3c75e7d32344 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:26:29.032843 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-4db1bfe5-b607-4d30-ad04-3c75e7d32344 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.311234 Apr 30 13:26:29.033667 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 522/1134] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:26:28 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:26:29.191728 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-9398f4b2-9679-45b0-a7e8-45647a3b038e tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb7384c0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:29.288856 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-9398f4b2-9679-45b0-a7e8-45647a3b038e tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.100785 Apr 30 13:26:29.289719 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 613/1135] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:29 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:26:30.052441 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-6dcb6423-7ba7-4a2d-aaa0-ab5ad3db5cc1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:30.053574 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-6dcb6423-7ba7-4a2d-aaa0-ab5ad3db5cc1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:26:30.061023 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6dcb6423-7ba7-4a2d-aaa0-ab5ad3db5cc1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:30.061484 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6dcb6423-7ba7-4a2d-aaa0-ab5ad3db5cc1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:30.062304 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6dcb6423-7ba7-4a2d-aaa0-ab5ad3db5cc1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:30.062752 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6dcb6423-7ba7-4a2d-aaa0-ab5ad3db5cc1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:30.265796 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-6dcb6423-7ba7-4a2d-aaa0-ab5ad3db5cc1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:26:30.274677 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-6dcb6423-7ba7-4a2d-aaa0-ab5ad3db5cc1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.225941 Apr 30 13:26:30.275345 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 523/1136] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:26:30 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:26:30.301536 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-59e73894-79df-4194-bb18-b431f99e9988 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500080790>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:30.395325 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-59e73894-79df-4194-bb18-b431f99e9988 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.097274 Apr 30 13:26:30.395893 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 614/1137] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:30 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:26:31.292673 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-f1295545-7b4b-4dd8-a407-cb9c28faacfd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:31.293314 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-f1295545-7b4b-4dd8-a407-cb9c28faacfd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:26:31.300952 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f1295545-7b4b-4dd8-a407-cb9c28faacfd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:31.301399 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f1295545-7b4b-4dd8-a407-cb9c28faacfd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:31.302215 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f1295545-7b4b-4dd8-a407-cb9c28faacfd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:31.302652 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f1295545-7b4b-4dd8-a407-cb9c28faacfd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:31.412539 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-ed659da1-3cd8-4b39-a818-cf2fb74463ee tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500080280>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:31.516997 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-ed659da1-3cd8-4b39-a818-cf2fb74463ee tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.108069 Apr 30 13:26:31.522496 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 615/1138] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:31 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:26:31.530967 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-f1295545-7b4b-4dd8-a407-cb9c28faacfd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:26:31.540737 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-f1295545-7b4b-4dd8-a407-cb9c28faacfd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.251747 Apr 30 13:26:31.541325 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 524/1139] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:26:31 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:26:32.529206 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-cab8a138-17ca-4df2-8828-2905c5cbad3e tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb738430>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:32.561024 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-5e6ad48e-29d0-41ad-9936-d47aaff4bc5e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:32.561667 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-5e6ad48e-29d0-41ad-9936-d47aaff4bc5e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:26:32.570372 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5e6ad48e-29d0-41ad-9936-d47aaff4bc5e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:32.570836 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5e6ad48e-29d0-41ad-9936-d47aaff4bc5e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:32.571648 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5e6ad48e-29d0-41ad-9936-d47aaff4bc5e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:32.572095 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5e6ad48e-29d0-41ad-9936-d47aaff4bc5e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:32.630603 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-cab8a138-17ca-4df2-8828-2905c5cbad3e tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.105350 Apr 30 13:26:32.631722 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 616/1140] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:32 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:26:32.789117 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-5e6ad48e-29d0-41ad-9936-d47aaff4bc5e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:26:32.797741 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-5e6ad48e-29d0-41ad-9936-d47aaff4bc5e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.240469 Apr 30 13:26:32.798350 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 525/1141] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:26:32 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:26:33.643753 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-2d55cff6-b953-4dd5-947e-40644b9ac6b4 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500146160>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:33.742628 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-2d55cff6-b953-4dd5-947e-40644b9ac6b4 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.102643 Apr 30 13:26:33.743356 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 617/1142] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:33 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:26:33.816233 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-493f1102-7bd5-403e-8c5e-ae21e869ff07 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:33.817100 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-493f1102-7bd5-403e-8c5e-ae21e869ff07 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:26:33.826566 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-493f1102-7bd5-403e-8c5e-ae21e869ff07 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:33.827014 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-493f1102-7bd5-403e-8c5e-ae21e869ff07 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:33.827866 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-493f1102-7bd5-403e-8c5e-ae21e869ff07 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:33.828333 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-493f1102-7bd5-403e-8c5e-ae21e869ff07 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:34.092372 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-493f1102-7bd5-403e-8c5e-ae21e869ff07 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:26:34.106738 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-493f1102-7bd5-403e-8c5e-ae21e869ff07 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.294780 Apr 30 13:26:34.107346 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 526/1143] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:26:33 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:26:34.756839 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-48e82433-58ab-4c8e-a89b-7942da35d26b tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb7d6430>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:34.854215 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-48e82433-58ab-4c8e-a89b-7942da35d26b tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.101513 Apr 30 13:26:34.854852 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 618/1144] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:34 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:26:35.125134 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-dc95f4e5-6c67-4fe7-a683-ac3430c65445 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:35.125748 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-dc95f4e5-6c67-4fe7-a683-ac3430c65445 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:26:35.133755 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-dc95f4e5-6c67-4fe7-a683-ac3430c65445 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:35.134248 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-dc95f4e5-6c67-4fe7-a683-ac3430c65445 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:35.135041 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-dc95f4e5-6c67-4fe7-a683-ac3430c65445 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:35.135479 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-dc95f4e5-6c67-4fe7-a683-ac3430c65445 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:35.346177 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-dc95f4e5-6c67-4fe7-a683-ac3430c65445 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:26:35.354976 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-dc95f4e5-6c67-4fe7-a683-ac3430c65445 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.233537 Apr 30 13:26:35.355554 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 527/1145] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:26:35 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:26:35.867639 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-700ba957-fd50-4fe6-9650-3c9f79e1ec27 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb7d65e0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:35.964439 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-700ba957-fd50-4fe6-9650-3c9f79e1ec27 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.101317 Apr 30 13:26:35.965031 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 619/1146] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:35 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:26:36.372152 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-0ab6f9ca-b4ab-497c-8230-d166b43e2b3a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:36.372774 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-0ab6f9ca-b4ab-497c-8230-d166b43e2b3a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:26:36.380372 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0ab6f9ca-b4ab-497c-8230-d166b43e2b3a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:36.380832 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0ab6f9ca-b4ab-497c-8230-d166b43e2b3a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:36.382387 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0ab6f9ca-b4ab-497c-8230-d166b43e2b3a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:36.383117 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0ab6f9ca-b4ab-497c-8230-d166b43e2b3a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:36.588860 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-0ab6f9ca-b4ab-497c-8230-d166b43e2b3a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:26:36.598332 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-0ab6f9ca-b4ab-497c-8230-d166b43e2b3a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.229874 Apr 30 13:26:36.598897 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 528/1147] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:26:36 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:26:36.980144 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-91a51aaa-8e49-4d4e-9c86-83cf2f1cda6c tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500badd30>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:37.072079 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-91a51aaa-8e49-4d4e-9c86-83cf2f1cda6c tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.095585 Apr 30 13:26:37.072664 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 620/1148] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:36 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:26:37.616056 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-6f15ebcf-2f5a-482d-83bd-a6ffb4393a42 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:37.616692 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-6f15ebcf-2f5a-482d-83bd-a6ffb4393a42 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:26:37.624772 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6f15ebcf-2f5a-482d-83bd-a6ffb4393a42 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:37.625229 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6f15ebcf-2f5a-482d-83bd-a6ffb4393a42 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:37.626028 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6f15ebcf-2f5a-482d-83bd-a6ffb4393a42 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:37.626494 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6f15ebcf-2f5a-482d-83bd-a6ffb4393a42 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:37.825300 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-6f15ebcf-2f5a-482d-83bd-a6ffb4393a42 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:26:37.835882 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-6f15ebcf-2f5a-482d-83bd-a6ffb4393a42 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.222571 Apr 30 13:26:37.836465 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 529/1149] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:26:37 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:26:38.084766 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-6284a6e2-e7cd-434e-b3df-a11261c2c4cb tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb738430>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:38.179488 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-6284a6e2-e7cd-434e-b3df-a11261c2c4cb tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.098695 Apr 30 13:26:38.180158 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 621/1150] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:38 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:26:38.853469 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-7e55c91a-4053-4ba7-830f-d0f48d866a37 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:38.854154 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-7e55c91a-4053-4ba7-830f-d0f48d866a37 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:26:38.861837 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7e55c91a-4053-4ba7-830f-d0f48d866a37 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:38.862313 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7e55c91a-4053-4ba7-830f-d0f48d866a37 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:38.863103 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7e55c91a-4053-4ba7-830f-d0f48d866a37 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:38.863540 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7e55c91a-4053-4ba7-830f-d0f48d866a37 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:39.134359 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-7e55c91a-4053-4ba7-830f-d0f48d866a37 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:26:39.142862 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-7e55c91a-4053-4ba7-830f-d0f48d866a37 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.293730 Apr 30 13:26:39.143550 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 530/1151] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:26:38 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:26:39.191645 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-09f6586e-f0eb-4123-8dd3-e662da7763c3 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500080700>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:39.307243 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-09f6586e-f0eb-4123-8dd3-e662da7763c3 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.118819 Apr 30 13:26:39.313590 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 622/1152] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:39 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:26:40.160253 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-9a30cb94-9c65-4778-85b6-f584a5c76332 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:40.161032 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-9a30cb94-9c65-4778-85b6-f584a5c76332 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:26:40.169125 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9a30cb94-9c65-4778-85b6-f584a5c76332 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:40.169580 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9a30cb94-9c65-4778-85b6-f584a5c76332 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:40.170397 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9a30cb94-9c65-4778-85b6-f584a5c76332 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:40.170842 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9a30cb94-9c65-4778-85b6-f584a5c76332 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:40.320606 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-7d01781d-75ea-43b5-b284-0a92f21e02f1 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500080a60>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:40.421301 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-9a30cb94-9c65-4778-85b6-f584a5c76332 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:26:40.430878 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-9a30cb94-9c65-4778-85b6-f584a5c76332 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.274357 Apr 30 13:26:40.431471 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 531/1153] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:26:40 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:26:40.495052 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-7d01781d-75ea-43b5-b284-0a92f21e02f1 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.178482 Apr 30 13:26:40.495626 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 623/1154] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:40 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:26:41.451672 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-87789110-9441-4ed4-924c-d998c68f8dd3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:41.452350 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-87789110-9441-4ed4-924c-d998c68f8dd3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:26:41.460760 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-87789110-9441-4ed4-924c-d998c68f8dd3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:41.461211 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-87789110-9441-4ed4-924c-d998c68f8dd3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:41.462000 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-87789110-9441-4ed4-924c-d998c68f8dd3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:41.462471 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-87789110-9441-4ed4-924c-d998c68f8dd3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:41.507231 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-dc4c4607-ac87-4b72-a887-20936209748f tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb7384c0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:41.610217 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-dc4c4607-ac87-4b72-a887-20936209748f tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.107277 Apr 30 13:26:41.610937 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 624/1155] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:41 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:26:41.665156 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-87789110-9441-4ed4-924c-d998c68f8dd3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:26:41.673768 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-87789110-9441-4ed4-924c-d998c68f8dd3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.225777 Apr 30 13:26:41.674462 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 532/1156] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:26:41 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:26:42.622116 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-7d1e54d1-b203-4cb2-87ae-bb4848cc2633 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500146160>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:42.669722 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:26:42.670026 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: Fri Apr 30 13:26:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 (ip 10.222.0.79) !!! Apr 30 13:26:42.692073 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-1f452306-5e04-4b6e-96af-ae3b253c8794 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:42.692704 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-1f452306-5e04-4b6e-96af-ae3b253c8794 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:26:42.700582 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1f452306-5e04-4b6e-96af-ae3b253c8794 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:42.701207 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1f452306-5e04-4b6e-96af-ae3b253c8794 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:42.702030 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1f452306-5e04-4b6e-96af-ae3b253c8794 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:42.702557 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1f452306-5e04-4b6e-96af-ae3b253c8794 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:42.714773 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-7d1e54d1-b203-4cb2-87ae-bb4848cc2633 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.096284 Apr 30 13:26:42.715538 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 625/1157] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:42 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:26:42.904912 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-1f452306-5e04-4b6e-96af-ae3b253c8794 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:26:42.914316 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-1f452306-5e04-4b6e-96af-ae3b253c8794 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.227032 Apr 30 13:26:42.914886 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 533/1158] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:26:42 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:26:43.726928 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-ad51a8a3-4b8b-4452-94cd-819cab339101 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb7d68b0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:43.828496 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-ad51a8a3-4b8b-4452-94cd-819cab339101 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.105152 Apr 30 13:26:43.833406 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 626/1159] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:43 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:26:43.931606 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-834f40e0-fb45-498f-a629-7001f40b50dc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:43.932228 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-834f40e0-fb45-498f-a629-7001f40b50dc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:26:43.939937 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-834f40e0-fb45-498f-a629-7001f40b50dc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:43.940392 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-834f40e0-fb45-498f-a629-7001f40b50dc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:43.941177 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-834f40e0-fb45-498f-a629-7001f40b50dc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:43.941619 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-834f40e0-fb45-498f-a629-7001f40b50dc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:44.150410 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-834f40e0-fb45-498f-a629-7001f40b50dc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:26:44.158648 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-834f40e0-fb45-498f-a629-7001f40b50dc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.231643 Apr 30 13:26:44.159203 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 534/1160] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:26:43 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:26:44.841798 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-bc7bb0a5-a798-48bd-baaf-289b9de1c21c tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500bade50>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:44.947791 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-bc7bb0a5-a798-48bd-baaf-289b9de1c21c tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.110395 Apr 30 13:26:44.948375 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 627/1161] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:44 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:26:45.176920 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-a609268a-2b35-43c4-a871-d0ace4c07af6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:45.177553 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-a609268a-2b35-43c4-a871-d0ace4c07af6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:26:45.187355 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a609268a-2b35-43c4-a871-d0ace4c07af6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:45.187823 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a609268a-2b35-43c4-a871-d0ace4c07af6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:45.188641 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a609268a-2b35-43c4-a871-d0ace4c07af6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:45.189235 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a609268a-2b35-43c4-a871-d0ace4c07af6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:45.388206 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-a609268a-2b35-43c4-a871-d0ace4c07af6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:26:45.397728 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-a609268a-2b35-43c4-a871-d0ace4c07af6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.224524 Apr 30 13:26:45.398414 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 535/1162] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:26:45 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:26:45.960771 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-12e1d031-b131-4b60-b7bc-98ed9ef69617 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500c6f670>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:46.058964 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-12e1d031-b131-4b60-b7bc-98ed9ef69617 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.102426 Apr 30 13:26:46.059780 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 628/1163] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:45 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:26:46.415812 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-7da2fd6d-f6a6-458f-bb21-5b087f04f4f8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:46.416362 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-7da2fd6d-f6a6-458f-bb21-5b087f04f4f8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:26:46.424199 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7da2fd6d-f6a6-458f-bb21-5b087f04f4f8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:46.424646 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7da2fd6d-f6a6-458f-bb21-5b087f04f4f8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:46.425438 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7da2fd6d-f6a6-458f-bb21-5b087f04f4f8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:46.425941 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7da2fd6d-f6a6-458f-bb21-5b087f04f4f8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:46.634475 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-7da2fd6d-f6a6-458f-bb21-5b087f04f4f8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:26:46.643301 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-7da2fd6d-f6a6-458f-bb21-5b087f04f4f8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.231800 Apr 30 13:26:46.643881 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 536/1164] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:26:46 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:26:46.668597 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:26:46.668780 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: Fri Apr 30 13:26:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:26:47.072647 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-9bd6ba4e-6893-4650-87f8-71d4abb79bf7 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb7d1820>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:47.172593 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-9bd6ba4e-6893-4650-87f8-71d4abb79bf7 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.104182 Apr 30 13:26:47.173251 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 629/1165] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:47 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:26:47.661182 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-8b9640d2-0494-40cc-8def-3b2c11adf557 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:47.662403 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-8b9640d2-0494-40cc-8def-3b2c11adf557 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:26:47.669802 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8b9640d2-0494-40cc-8def-3b2c11adf557 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:47.670281 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8b9640d2-0494-40cc-8def-3b2c11adf557 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:47.671073 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8b9640d2-0494-40cc-8def-3b2c11adf557 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:47.671509 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8b9640d2-0494-40cc-8def-3b2c11adf557 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:47.876024 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-8b9640d2-0494-40cc-8def-3b2c11adf557 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:26:47.885076 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-8b9640d2-0494-40cc-8def-3b2c11adf557 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.228230 Apr 30 13:26:47.885672 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 537/1166] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:26:47 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:26:48.184770 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-fa6681aa-bcbc-4693-a758-708350ef9e3c tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500080280>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:48.280651 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-fa6681aa-bcbc-4693-a758-708350ef9e3c tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.099432 Apr 30 13:26:48.281308 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 630/1167] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:48 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:26:48.902869 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-38301bef-7ea8-4516-82d6-3024412419b6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:48.903415 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-38301bef-7ea8-4516-82d6-3024412419b6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:26:48.911581 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-38301bef-7ea8-4516-82d6-3024412419b6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:48.912179 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-38301bef-7ea8-4516-82d6-3024412419b6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:48.913118 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-38301bef-7ea8-4516-82d6-3024412419b6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:48.913713 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-38301bef-7ea8-4516-82d6-3024412419b6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:49.118174 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-38301bef-7ea8-4516-82d6-3024412419b6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:26:49.126828 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-38301bef-7ea8-4516-82d6-3024412419b6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.227718 Apr 30 13:26:49.127399 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 538/1168] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:26:48 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:26:49.293194 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-a09e8d74-add3-4e39-90ca-355a0f33c9a7 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb7384c0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:49.387910 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-a09e8d74-add3-4e39-90ca-355a0f33c9a7 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.098536 Apr 30 13:26:49.388626 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 631/1169] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:49 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:26:50.143764 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-583dbc9c-b76e-4f38-b678-c0561392eb4e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:50.144439 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-583dbc9c-b76e-4f38-b678-c0561392eb4e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:26:50.152224 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-583dbc9c-b76e-4f38-b678-c0561392eb4e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:50.152674 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-583dbc9c-b76e-4f38-b678-c0561392eb4e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:50.153466 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-583dbc9c-b76e-4f38-b678-c0561392eb4e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:50.153907 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-583dbc9c-b76e-4f38-b678-c0561392eb4e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:50.401296 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-769e31ee-328a-4294-8709-20e68a54ae43 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f75001460d0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:50.446558 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-583dbc9c-b76e-4f38-b678-c0561392eb4e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:26:50.455003 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-583dbc9c-b76e-4f38-b678-c0561392eb4e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.315003 Apr 30 13:26:50.456008 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 539/1170] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:26:50 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:26:50.494830 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-769e31ee-328a-4294-8709-20e68a54ae43 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.098220 Apr 30 13:26:50.495411 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 632/1171] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:50 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:26:51.473034 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-523717c9-466c-4b8a-9fe4-00f8e79dfbdf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:51.473660 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-523717c9-466c-4b8a-9fe4-00f8e79dfbdf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:26:51.482763 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-523717c9-466c-4b8a-9fe4-00f8e79dfbdf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:51.483223 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-523717c9-466c-4b8a-9fe4-00f8e79dfbdf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:51.484038 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-523717c9-466c-4b8a-9fe4-00f8e79dfbdf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:51.484470 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-523717c9-466c-4b8a-9fe4-00f8e79dfbdf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:51.507053 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-f841c80c-3514-434a-be27-b914d42e2513 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb7d1b80>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:51.613861 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-f841c80c-3514-434a-be27-b914d42e2513 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.110407 Apr 30 13:26:51.614571 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 633/1172] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:51 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:26:51.698032 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-523717c9-466c-4b8a-9fe4-00f8e79dfbdf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:26:51.706546 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-523717c9-466c-4b8a-9fe4-00f8e79dfbdf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.237468 Apr 30 13:26:51.707118 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 540/1173] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:26:51 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:26:52.626136 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-c830d6c2-dd34-4249-bde6-f8664d9320b3 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb738e50>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:52.720977 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-c830d6c2-dd34-4249-bde6-f8664d9320b3 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.098720 Apr 30 13:26:52.721541 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 634/1174] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:52 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:26:52.724466 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-8b0a7217-ec36-4311-acaf-e9c7e2bad6ad tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:52.725206 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-8b0a7217-ec36-4311-acaf-e9c7e2bad6ad tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:26:52.732789 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8b0a7217-ec36-4311-acaf-e9c7e2bad6ad tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:52.733242 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8b0a7217-ec36-4311-acaf-e9c7e2bad6ad tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:52.734071 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8b0a7217-ec36-4311-acaf-e9c7e2bad6ad tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:52.734519 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8b0a7217-ec36-4311-acaf-e9c7e2bad6ad tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:52.938800 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-8b0a7217-ec36-4311-acaf-e9c7e2bad6ad tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:26:52.947641 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-8b0a7217-ec36-4311-acaf-e9c7e2bad6ad tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.226988 Apr 30 13:26:52.948210 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 541/1175] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:26:52 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:26:53.732487 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-3d73a3fe-9a0b-4016-8d9b-20824936a53c tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500146670>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:53.825444 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-3d73a3fe-9a0b-4016-8d9b-20824936a53c tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.096532 Apr 30 13:26:53.826050 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 635/1176] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:53 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:26:53.965205 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-c2530c9e-5655-4f63-9497-5cf1c852f24e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:53.965874 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-c2530c9e-5655-4f63-9497-5cf1c852f24e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:26:53.973580 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c2530c9e-5655-4f63-9497-5cf1c852f24e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:53.974231 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c2530c9e-5655-4f63-9497-5cf1c852f24e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:53.975152 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c2530c9e-5655-4f63-9497-5cf1c852f24e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:53.975603 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c2530c9e-5655-4f63-9497-5cf1c852f24e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:54.184996 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-c2530c9e-5655-4f63-9497-5cf1c852f24e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:26:54.194229 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-c2530c9e-5655-4f63-9497-5cf1c852f24e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.232052 Apr 30 13:26:54.194807 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 542/1177] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:26:53 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:26:54.838045 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-0b622590-9050-4806-ac7b-89d88ecb81fa tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500badd30>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:54.962530 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-0b622590-9050-4806-ac7b-89d88ecb81fa tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.124680 Apr 30 13:26:54.962530 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 636/1178] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:54 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:26:55.210521 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-0b18dc98-7079-47e7-bf2e-95d6a986e94f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:55.211146 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-0b18dc98-7079-47e7-bf2e-95d6a986e94f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:26:55.218709 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0b18dc98-7079-47e7-bf2e-95d6a986e94f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:55.219163 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0b18dc98-7079-47e7-bf2e-95d6a986e94f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:55.219950 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0b18dc98-7079-47e7-bf2e-95d6a986e94f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:55.220391 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0b18dc98-7079-47e7-bf2e-95d6a986e94f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:55.469341 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-0b18dc98-7079-47e7-bf2e-95d6a986e94f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:26:55.479329 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-0b18dc98-7079-47e7-bf2e-95d6a986e94f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.272654 Apr 30 13:26:55.480230 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 543/1179] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:26:55 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:26:55.971693 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-16d6723e-f045-47f1-9891-871909355ebf tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500080280>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:56.081410 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-16d6723e-f045-47f1-9891-871909355ebf tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.114638 Apr 30 13:26:56.081977 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 637/1180] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:55 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:26:56.496859 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-d8cd5ba2-9584-4cd5-8d56-c203e939e7f0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:56.497476 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-d8cd5ba2-9584-4cd5-8d56-c203e939e7f0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:26:56.504832 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d8cd5ba2-9584-4cd5-8d56-c203e939e7f0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:56.505358 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d8cd5ba2-9584-4cd5-8d56-c203e939e7f0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:56.506246 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d8cd5ba2-9584-4cd5-8d56-c203e939e7f0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:56.506694 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d8cd5ba2-9584-4cd5-8d56-c203e939e7f0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:56.713526 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-d8cd5ba2-9584-4cd5-8d56-c203e939e7f0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:26:56.721797 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-d8cd5ba2-9584-4cd5-8d56-c203e939e7f0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.228693 Apr 30 13:26:56.722400 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 544/1181] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:26:56 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:26:57.093970 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-efea82f4-4d46-4cdf-82b0-19fb13707c03 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500080700>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:57.189316 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-efea82f4-4d46-4cdf-82b0-19fb13707c03 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.098911 Apr 30 13:26:57.189894 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 638/1182] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:57 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:26:57.739853 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-b932d817-b6ec-4b91-bf36-49b4bd1427f5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:57.740472 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-b932d817-b6ec-4b91-bf36-49b4bd1427f5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:26:57.747876 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b932d817-b6ec-4b91-bf36-49b4bd1427f5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:57.748329 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b932d817-b6ec-4b91-bf36-49b4bd1427f5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:57.749113 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b932d817-b6ec-4b91-bf36-49b4bd1427f5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:57.749549 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b932d817-b6ec-4b91-bf36-49b4bd1427f5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:57.961328 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-b932d817-b6ec-4b91-bf36-49b4bd1427f5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:26:57.970108 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-b932d817-b6ec-4b91-bf36-49b4bd1427f5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.233927 Apr 30 13:26:57.970686 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 545/1183] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:26:57 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:26:58.204890 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-db532574-cf34-4be4-b0a9-965acead54c7 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500bad8b0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:58.304320 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-db532574-cf34-4be4-b0a9-965acead54c7 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.105711 Apr 30 13:26:58.304895 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 639/1184] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:58 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:26:58.988802 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-a49b2505-dab6-4c3e-973b-eaac75abe3ae tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:58.989427 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-a49b2505-dab6-4c3e-973b-eaac75abe3ae tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:26:58.997708 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a49b2505-dab6-4c3e-973b-eaac75abe3ae tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:58.998203 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a49b2505-dab6-4c3e-973b-eaac75abe3ae tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:58.999028 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a49b2505-dab6-4c3e-973b-eaac75abe3ae tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:26:58.999468 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a49b2505-dab6-4c3e-973b-eaac75abe3ae tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:26:59.209472 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-a49b2505-dab6-4c3e-973b-eaac75abe3ae tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:26:59.218175 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-a49b2505-dab6-4c3e-973b-eaac75abe3ae tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.233367 Apr 30 13:26:59.218649 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 546/1185] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:26:58 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:26:59.317082 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-9458f232-083f-4d2e-89ed-60d825719b28 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500146940>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:26:59.411492 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-9458f232-083f-4d2e-89ed-60d825719b28 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.098169 Apr 30 13:26:59.412083 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 640/1186] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:26:59 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:27:00.236239 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-a5254494-c23a-4468-a64a-9d831e458e99 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:00.236871 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-a5254494-c23a-4468-a64a-9d831e458e99 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:00.244714 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a5254494-c23a-4468-a64a-9d831e458e99 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:00.245176 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a5254494-c23a-4468-a64a-9d831e458e99 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:00.245979 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a5254494-c23a-4468-a64a-9d831e458e99 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:00.246448 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a5254494-c23a-4468-a64a-9d831e458e99 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:00.424150 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b3451354-630a-4d28-bd6e-f6f2384fd8bc tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb738ca0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:00.522594 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b3451354-630a-4d28-bd6e-f6f2384fd8bc tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.102120 Apr 30 13:27:00.523380 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 641/1187] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:27:00 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:27:00.561206 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-a5254494-c23a-4468-a64a-9d831e458e99 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:00.570170 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-a5254494-c23a-4468-a64a-9d831e458e99 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.337995 Apr 30 13:27:00.570759 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 547/1188] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:00 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:27:01.534928 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-9cedd631-6dc2-4628-8565-01d444a3f061 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb7388b0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:01.587702 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-a9adabde-a6cd-4c14-b175-928536ab4b09 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:01.588431 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-a9adabde-a6cd-4c14-b175-928536ab4b09 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:01.596679 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a9adabde-a6cd-4c14-b175-928536ab4b09 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:01.596679 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a9adabde-a6cd-4c14-b175-928536ab4b09 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:01.597088 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a9adabde-a6cd-4c14-b175-928536ab4b09 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:01.597530 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a9adabde-a6cd-4c14-b175-928536ab4b09 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:01.627337 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-9cedd631-6dc2-4628-8565-01d444a3f061 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.095916 Apr 30 13:27:01.628034 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 642/1189] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:27:01 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:27:01.793941 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:27:01.794401 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: Fri Apr 30 13:27:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:27:01.799835 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-a9adabde-a6cd-4c14-b175-928536ab4b09 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:01.812719 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-a9adabde-a6cd-4c14-b175-928536ab4b09 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.229212 Apr 30 13:27:01.813296 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 548/1190] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:01 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:27:02.438737 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:27:02.438968 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: Fri Apr 30 13:27:02 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:27:02.640237 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-f4b487de-d538-4fac-a318-48541bfad3f4 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb7d65e0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:02.740994 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-f4b487de-d538-4fac-a318-48541bfad3f4 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.104710 Apr 30 13:27:02.741561 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 643/1191] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:27:02 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:27:02.835175 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-1e86fbc1-f9e7-440f-9181-ff3b8e797a6e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:02.836372 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-1e86fbc1-f9e7-440f-9181-ff3b8e797a6e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:02.850259 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1e86fbc1-f9e7-440f-9181-ff3b8e797a6e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:02.850866 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1e86fbc1-f9e7-440f-9181-ff3b8e797a6e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:02.852232 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1e86fbc1-f9e7-440f-9181-ff3b8e797a6e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:02.852954 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1e86fbc1-f9e7-440f-9181-ff3b8e797a6e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:03.091702 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-1e86fbc1-f9e7-440f-9181-ff3b8e797a6e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:03.100587 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-1e86fbc1-f9e7-440f-9181-ff3b8e797a6e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.272944 Apr 30 13:27:03.101174 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 549/1192] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:02 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:27:03.752692 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b0b37a2e-b2fe-4a2d-b01e-17aa8f8dbe5a tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500bad820>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:03.851628 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b0b37a2e-b2fe-4a2d-b01e-17aa8f8dbe5a tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.102654 Apr 30 13:27:03.852202 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 644/1193] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:27:03 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:27:04.118933 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-c6364c7c-a59d-4546-818c-20aef56a9b8d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:04.119489 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-c6364c7c-a59d-4546-818c-20aef56a9b8d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:04.127322 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c6364c7c-a59d-4546-818c-20aef56a9b8d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:04.127764 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c6364c7c-a59d-4546-818c-20aef56a9b8d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:04.128550 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c6364c7c-a59d-4546-818c-20aef56a9b8d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:04.128985 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c6364c7c-a59d-4546-818c-20aef56a9b8d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:04.338482 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-c6364c7c-a59d-4546-818c-20aef56a9b8d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:04.347236 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-c6364c7c-a59d-4546-818c-20aef56a9b8d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.232871 Apr 30 13:27:04.347721 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 550/1194] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:04 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:27:04.863394 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-61d9862d-54af-446d-9f65-340a87057e67 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500c6f9d0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:04.964298 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-61d9862d-54af-446d-9f65-340a87057e67 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.104528 Apr 30 13:27:04.964904 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 645/1195] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:27:04 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:27:05.365453 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-be69b713-baca-4b8c-9778-b339c8f7bc45 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:05.366105 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-be69b713-baca-4b8c-9778-b339c8f7bc45 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:05.373612 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-be69b713-baca-4b8c-9778-b339c8f7bc45 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:05.374114 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-be69b713-baca-4b8c-9778-b339c8f7bc45 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:05.375732 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-be69b713-baca-4b8c-9778-b339c8f7bc45 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:05.375732 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-be69b713-baca-4b8c-9778-b339c8f7bc45 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:05.582833 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-be69b713-baca-4b8c-9778-b339c8f7bc45 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:05.591796 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-be69b713-baca-4b8c-9778-b339c8f7bc45 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.230771 Apr 30 13:27:05.592452 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 551/1196] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:05 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:27:05.977020 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-cb52deda-230c-4595-92d1-d8617b4cb5b8 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500080790>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:06.071596 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-cb52deda-230c-4595-92d1-d8617b4cb5b8 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.098835 Apr 30 13:27:06.072172 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 646/1197] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:27:05 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:27:06.609639 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-39658e9c-9935-4daf-a215-bd9a4fe7d356 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:06.610279 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-39658e9c-9935-4daf-a215-bd9a4fe7d356 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:06.618301 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-39658e9c-9935-4daf-a215-bd9a4fe7d356 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:06.618751 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-39658e9c-9935-4daf-a215-bd9a4fe7d356 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:06.619543 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-39658e9c-9935-4daf-a215-bd9a4fe7d356 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:06.619987 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-39658e9c-9935-4daf-a215-bd9a4fe7d356 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:06.863862 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-39658e9c-9935-4daf-a215-bd9a4fe7d356 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:06.874383 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-39658e9c-9935-4daf-a215-bd9a4fe7d356 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.268297 Apr 30 13:27:06.875073 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 552/1198] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:06 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:27:07.084623 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b73c4743-8fda-4c9c-946a-aef37db16216 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb7d1c10>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:07.180078 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b73c4743-8fda-4c9c-946a-aef37db16216 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.099465 Apr 30 13:27:07.180646 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 647/1199] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:27:07 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:27:07.393438 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:27:07.393647 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: Fri Apr 30 13:27:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:27:07.892930 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-9e407965-eb98-4787-b521-0a429dda6dbd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:07.893617 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-9e407965-eb98-4787-b521-0a429dda6dbd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:07.901967 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9e407965-eb98-4787-b521-0a429dda6dbd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:07.902454 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9e407965-eb98-4787-b521-0a429dda6dbd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:07.903259 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9e407965-eb98-4787-b521-0a429dda6dbd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:07.903706 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9e407965-eb98-4787-b521-0a429dda6dbd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:08.138873 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-9e407965-eb98-4787-b521-0a429dda6dbd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:08.147927 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-9e407965-eb98-4787-b521-0a429dda6dbd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.258734 Apr 30 13:27:08.148523 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 553/1200] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:07 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:27:08.192404 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-899c5d79-0449-411d-9307-c006e9211330 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f74fb7d19d0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:08.289924 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-899c5d79-0449-411d-9307-c006e9211330 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.101092 Apr 30 13:27:08.290546 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 648/1201] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:27:08 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:27:09.167660 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-f772c14b-f670-4703-b959-1c2356afb97c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:09.168187 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-f772c14b-f670-4703-b959-1c2356afb97c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:09.175560 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f772c14b-f670-4703-b959-1c2356afb97c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:09.176008 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f772c14b-f670-4703-b959-1c2356afb97c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:09.177287 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f772c14b-f670-4703-b959-1c2356afb97c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:09.177981 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f772c14b-f670-4703-b959-1c2356afb97c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:09.302814 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-9be244d0-2a97-46bb-afed-25c8603d642b tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500080700>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:09.387926 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-f772c14b-f670-4703-b959-1c2356afb97c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:09.397145 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-f772c14b-f670-4703-b959-1c2356afb97c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.233147 Apr 30 13:27:09.397765 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 554/1202] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:09 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:27:09.399058 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-9be244d0-2a97-46bb-afed-25c8603d642b tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.100364 Apr 30 13:27:09.399635 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 649/1203] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:27:09 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:27:10.412136 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-90396018-0da8-49ae-a933-e3a28e69ba4f tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750015d1f0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:10.414707 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-6e41c974-24bf-4e08-b199-cd9ffc1824ca tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:10.415329 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-6e41c974-24bf-4e08-b199-cd9ffc1824ca tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:10.423264 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6e41c974-24bf-4e08-b199-cd9ffc1824ca tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:10.423716 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6e41c974-24bf-4e08-b199-cd9ffc1824ca tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:10.424497 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6e41c974-24bf-4e08-b199-cd9ffc1824ca tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:10.424936 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6e41c974-24bf-4e08-b199-cd9ffc1824ca tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:10.507264 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-90396018-0da8-49ae-a933-e3a28e69ba4f tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.099230 Apr 30 13:27:10.507833 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 555/1204] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:27:10 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:27:10.660194 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-6e41c974-24bf-4e08-b199-cd9ffc1824ca tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:10.669155 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-6e41c974-24bf-4e08-b199-cd9ffc1824ca tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.258936 Apr 30 13:27:10.669731 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 650/1205] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:10 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:27:11.520064 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-d6617f01-9423-4afd-bd7b-47153373e8b6 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f75002ca790>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:11.618060 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-d6617f01-9423-4afd-bd7b-47153373e8b6 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.102817 Apr 30 13:27:11.618644 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 556/1206] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:27:11 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:27:11.687261 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-05fd3520-0dae-40ef-a342-ef34f25428ac tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:11.687818 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-05fd3520-0dae-40ef-a342-ef34f25428ac tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:11.696381 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-05fd3520-0dae-40ef-a342-ef34f25428ac tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:11.696829 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-05fd3520-0dae-40ef-a342-ef34f25428ac tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:11.697620 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-05fd3520-0dae-40ef-a342-ef34f25428ac tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:11.698092 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-05fd3520-0dae-40ef-a342-ef34f25428ac tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:11.920218 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-05fd3520-0dae-40ef-a342-ef34f25428ac tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:11.931700 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-05fd3520-0dae-40ef-a342-ef34f25428ac tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.248454 Apr 30 13:27:11.932280 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 651/1207] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:11 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:27:12.630942 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-c6bb412c-9230-41ea-8412-975482d83f3a tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f75002ca280>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:12.726513 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-c6bb412c-9230-41ea-8412-975482d83f3a tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.099694 Apr 30 13:27:12.727104 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 557/1208] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:27:12 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:27:12.954564 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-676cdebc-e7a1-49bf-83dc-09574ecb5044 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:12.955165 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-676cdebc-e7a1-49bf-83dc-09574ecb5044 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:12.963167 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-676cdebc-e7a1-49bf-83dc-09574ecb5044 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:12.963630 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-676cdebc-e7a1-49bf-83dc-09574ecb5044 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:12.964423 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-676cdebc-e7a1-49bf-83dc-09574ecb5044 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:12.964864 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-676cdebc-e7a1-49bf-83dc-09574ecb5044 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:13.160874 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-676cdebc-e7a1-49bf-83dc-09574ecb5044 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:13.171644 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-676cdebc-e7a1-49bf-83dc-09574ecb5044 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.220740 Apr 30 13:27:13.172222 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 652/1209] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:12 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:27:13.738863 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-a30b785c-bda0-4bf0-a1b2-14d821eebaed tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f75000eb1f0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:13.839312 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-a30b785c-bda0-4bf0-a1b2-14d821eebaed tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.104089 Apr 30 13:27:13.839915 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 558/1210] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:27:13 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:27:14.190597 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-e4123318-ea1b-494d-b6dd-2f34bd2eabde tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:14.191198 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-e4123318-ea1b-494d-b6dd-2f34bd2eabde tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:14.198682 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e4123318-ea1b-494d-b6dd-2f34bd2eabde tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:14.199144 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e4123318-ea1b-494d-b6dd-2f34bd2eabde tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:14.199932 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e4123318-ea1b-494d-b6dd-2f34bd2eabde tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:14.200373 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e4123318-ea1b-494d-b6dd-2f34bd2eabde tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:14.401883 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-e4123318-ea1b-494d-b6dd-2f34bd2eabde tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:14.410182 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-e4123318-ea1b-494d-b6dd-2f34bd2eabde tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.223321 Apr 30 13:27:14.411007 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 653/1211] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:14 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:27:14.851665 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-36c64211-ed94-42f8-a2c7-fa03f95883bb tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f75002ca4c0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:14.943721 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-36c64211-ed94-42f8-a2c7-fa03f95883bb tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.095743 Apr 30 13:27:14.944298 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 559/1212] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:27:14 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:27:15.428926 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-608d8bd2-16ad-4040-98d3-303abee42d36 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:15.431447 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-608d8bd2-16ad-4040-98d3-303abee42d36 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:15.437135 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-608d8bd2-16ad-4040-98d3-303abee42d36 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:15.437666 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-608d8bd2-16ad-4040-98d3-303abee42d36 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:15.438483 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-608d8bd2-16ad-4040-98d3-303abee42d36 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:15.438926 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-608d8bd2-16ad-4040-98d3-303abee42d36 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:15.642595 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-608d8bd2-16ad-4040-98d3-303abee42d36 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:15.651050 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-608d8bd2-16ad-4040-98d3-303abee42d36 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.226923 Apr 30 13:27:15.651612 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 654/1213] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:15 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:27:15.956251 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-0a3fb783-4950-460c-b851-46588dce8dd5 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f75002ca9d0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:16.052621 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-0a3fb783-4950-460c-b851-46588dce8dd5 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.099840 Apr 30 13:27:16.053192 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 560/1214] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:27:15 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:27:16.667873 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-39ad8f26-3bb7-4330-8744-571779047cab tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:16.668485 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-39ad8f26-3bb7-4330-8744-571779047cab tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:16.675871 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-39ad8f26-3bb7-4330-8744-571779047cab tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:16.676321 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-39ad8f26-3bb7-4330-8744-571779047cab tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:16.678046 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-39ad8f26-3bb7-4330-8744-571779047cab tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:16.678816 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-39ad8f26-3bb7-4330-8744-571779047cab tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:16.918621 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-39ad8f26-3bb7-4330-8744-571779047cab tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:16.928039 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-39ad8f26-3bb7-4330-8744-571779047cab tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.263868 Apr 30 13:27:16.928622 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 655/1215] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:16 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:27:16.941194 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:27:16.941366 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: Fri Apr 30 13:27:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:27:17.064593 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-218c618b-ef1d-4de2-9b36-d627d11824e1 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500b40310>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:17.168273 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-218c618b-ef1d-4de2-9b36-d627d11824e1 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.107337 Apr 30 13:27:17.168873 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 561/1216] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:27:17 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:27:17.948119 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-e3e2fbc9-7a62-4ce0-90ec-52eb0f2222e5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:17.948744 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-e3e2fbc9-7a62-4ce0-90ec-52eb0f2222e5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:17.956618 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e3e2fbc9-7a62-4ce0-90ec-52eb0f2222e5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:17.957069 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e3e2fbc9-7a62-4ce0-90ec-52eb0f2222e5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:17.957951 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e3e2fbc9-7a62-4ce0-90ec-52eb0f2222e5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:17.958702 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e3e2fbc9-7a62-4ce0-90ec-52eb0f2222e5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:18.162871 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-e3e2fbc9-7a62-4ce0-90ec-52eb0f2222e5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:18.171143 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-e3e2fbc9-7a62-4ce0-90ec-52eb0f2222e5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.226908 Apr 30 13:27:18.171702 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 656/1217] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:17 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:27:18.181005 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-f5164e96-3ffc-4c87-bbdb-87c75276c856 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f750015d280>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:18.271686 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-f5164e96-3ffc-4c87-bbdb-87c75276c856 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.094943 Apr 30 13:27:18.272269 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 562/1218] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:27:18 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:27:18.932897 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-189eeb17-23eb-416b-8fd0-823c9dbd955f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:18.933399 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-189eeb17-23eb-416b-8fd0-823c9dbd955f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:18.940771 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-189eeb17-23eb-416b-8fd0-823c9dbd955f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:18.941230 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-189eeb17-23eb-416b-8fd0-823c9dbd955f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:18.942045 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-189eeb17-23eb-416b-8fd0-823c9dbd955f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:18.943009 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-189eeb17-23eb-416b-8fd0-823c9dbd955f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:19.110392 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.objects.instance [None req-189eeb17-23eb-416b-8fd0-823c9dbd955f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lazy-loading 'services' on Instance uuid c4c66a3a-0046-442b-a6c9-54494d8a7722 {{(pid=87933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:27:19.188927 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-a71e7f89-d221-45ab-9320-18413818047d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:19.190307 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-a71e7f89-d221-45ab-9320-18413818047d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:19.200171 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a71e7f89-d221-45ab-9320-18413818047d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:19.200627 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a71e7f89-d221-45ab-9320-18413818047d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:19.201479 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a71e7f89-d221-45ab-9320-18413818047d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:19.201922 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a71e7f89-d221-45ab-9320-18413818047d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:19.264199 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-189eeb17-23eb-416b-8fd0-823c9dbd955f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722/os-volume_attachments/2abcea42-b805-487e-a58b-200e59b6a4d0" status: 202 len: 0 microversion: 2.1 time: 0.334403 Apr 30 13:27:19.267898 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 657/1219] 10.222.0.79 () {58 vars in 1416 bytes} [Fri Apr 30 13:27:18 2021] DELETE /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722/os-volume_attachments/2abcea42-b805-487e-a58b-200e59b6a4d0 => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:27:19.288576 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-0923f899-5f46-4ebd-b52b-0f820fc36433 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] Calling method '.version_select at 0x7f7500080790>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:19.409348 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-0923f899-5f46-4ebd-b52b-0f820fc36433 tempest-VolumesGetTestJSON-2055550881 tempest-VolumesGetTestJSON-2055550881-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37" status: 200 len: 352 microversion: 2.1 time: 0.125967 Apr 30 13:27:19.409927 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 658/1220] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:27:19 2021] GET /compute/v2.1/os-volumes/cb5eb58d-6e9f-44d9-9cc4-fde1ef051b37 => generated 352 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:27:19.421984 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-a71e7f89-d221-45ab-9320-18413818047d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:19.431475 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-a71e7f89-d221-45ab-9320-18413818047d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.246262 Apr 30 13:27:19.432055 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 563/1221] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:19 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:27:20.450182 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-1d198ded-8ab6-4fdf-b227-9e5b861a7f50 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:20.451009 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-1d198ded-8ab6-4fdf-b227-9e5b861a7f50 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:20.460041 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1d198ded-8ab6-4fdf-b227-9e5b861a7f50 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:20.461172 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1d198ded-8ab6-4fdf-b227-9e5b861a7f50 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:20.461966 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1d198ded-8ab6-4fdf-b227-9e5b861a7f50 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:20.462460 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1d198ded-8ab6-4fdf-b227-9e5b861a7f50 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:20.672431 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-1d198ded-8ab6-4fdf-b227-9e5b861a7f50 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:20.681940 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-1d198ded-8ab6-4fdf-b227-9e5b861a7f50 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.236092 Apr 30 13:27:20.682711 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 659/1222] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:20 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:27:21.699555 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-ef832658-3037-4fd9-a1dd-0958a30999e6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:21.700171 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-ef832658-3037-4fd9-a1dd-0958a30999e6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:21.708172 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ef832658-3037-4fd9-a1dd-0958a30999e6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:21.708759 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ef832658-3037-4fd9-a1dd-0958a30999e6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:21.709629 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ef832658-3037-4fd9-a1dd-0958a30999e6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:21.710106 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ef832658-3037-4fd9-a1dd-0958a30999e6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:21.916494 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-ef832658-3037-4fd9-a1dd-0958a30999e6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:21.925207 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-ef832658-3037-4fd9-a1dd-0958a30999e6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.229481 Apr 30 13:27:21.925788 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 564/1223] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:21 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:27:22.947238 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-822a70dc-3770-420d-aee6-1cc4b0bc83e1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:22.948364 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-822a70dc-3770-420d-aee6-1cc4b0bc83e1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:22.961650 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-822a70dc-3770-420d-aee6-1cc4b0bc83e1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:22.962461 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-822a70dc-3770-420d-aee6-1cc4b0bc83e1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:22.963837 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-822a70dc-3770-420d-aee6-1cc4b0bc83e1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:22.964661 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-822a70dc-3770-420d-aee6-1cc4b0bc83e1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:23.203101 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-822a70dc-3770-420d-aee6-1cc4b0bc83e1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:23.211693 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-822a70dc-3770-420d-aee6-1cc4b0bc83e1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.271949 Apr 30 13:27:23.212273 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 660/1224] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:22 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:27:24.229672 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-c9c534be-01cf-4083-9bb5-0f4455c28c04 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:24.230417 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-c9c534be-01cf-4083-9bb5-0f4455c28c04 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:24.238026 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c9c534be-01cf-4083-9bb5-0f4455c28c04 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:24.238483 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c9c534be-01cf-4083-9bb5-0f4455c28c04 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:24.239927 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c9c534be-01cf-4083-9bb5-0f4455c28c04 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:24.240369 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c9c534be-01cf-4083-9bb5-0f4455c28c04 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:24.540388 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-c9c534be-01cf-4083-9bb5-0f4455c28c04 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:24.549086 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-c9c534be-01cf-4083-9bb5-0f4455c28c04 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.323293 Apr 30 13:27:24.549663 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 565/1225] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:24 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:27:25.571412 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-5da0659f-9f33-411a-b71e-86b4f42a753a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:25.572568 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-5da0659f-9f33-411a-b71e-86b4f42a753a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:25.586092 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5da0659f-9f33-411a-b71e-86b4f42a753a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:25.586846 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5da0659f-9f33-411a-b71e-86b4f42a753a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:25.588096 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5da0659f-9f33-411a-b71e-86b4f42a753a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:25.588788 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5da0659f-9f33-411a-b71e-86b4f42a753a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:25.825408 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-5da0659f-9f33-411a-b71e-86b4f42a753a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:25.832226 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-5da0659f-9f33-411a-b71e-86b4f42a753a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.268701 Apr 30 13:27:25.833628 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 661/1226] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:25 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:27:26.850230 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-e26ad5d7-ab46-4ec4-a144-24699f2a42f8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:26.850856 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-e26ad5d7-ab46-4ec4-a144-24699f2a42f8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:26.858664 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e26ad5d7-ab46-4ec4-a144-24699f2a42f8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:26.859120 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e26ad5d7-ab46-4ec4-a144-24699f2a42f8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:26.859927 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e26ad5d7-ab46-4ec4-a144-24699f2a42f8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:26.860370 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e26ad5d7-ab46-4ec4-a144-24699f2a42f8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:27.067965 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-e26ad5d7-ab46-4ec4-a144-24699f2a42f8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:27.076204 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-e26ad5d7-ab46-4ec4-a144-24699f2a42f8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.229617 Apr 30 13:27:27.076724 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 566/1227] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:26 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:27:28.093174 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-9c4ef901-bd2d-40a4-b5a0-7d84bd270913 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:28.093717 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-9c4ef901-bd2d-40a4-b5a0-7d84bd270913 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:28.102153 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9c4ef901-bd2d-40a4-b5a0-7d84bd270913 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:28.102610 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9c4ef901-bd2d-40a4-b5a0-7d84bd270913 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:28.103404 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9c4ef901-bd2d-40a4-b5a0-7d84bd270913 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:28.103943 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9c4ef901-bd2d-40a4-b5a0-7d84bd270913 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:28.400209 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-9c4ef901-bd2d-40a4-b5a0-7d84bd270913 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:28.409325 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-9c4ef901-bd2d-40a4-b5a0-7d84bd270913 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.320000 Apr 30 13:27:28.409790 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 662/1228] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:28 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:27:29.428848 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-85b00590-efed-477c-8b13-4b7fa21f3286 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:29.429426 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-85b00590-efed-477c-8b13-4b7fa21f3286 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:29.436963 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-85b00590-efed-477c-8b13-4b7fa21f3286 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:29.437429 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-85b00590-efed-477c-8b13-4b7fa21f3286 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:29.438290 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-85b00590-efed-477c-8b13-4b7fa21f3286 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:29.438803 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-85b00590-efed-477c-8b13-4b7fa21f3286 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:29.656359 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-85b00590-efed-477c-8b13-4b7fa21f3286 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:29.665739 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-85b00590-efed-477c-8b13-4b7fa21f3286 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.241809 Apr 30 13:27:29.666358 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 567/1229] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:29 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:27:30.683005 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-fb687071-71be-4a1d-a023-8164fd7d7075 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:30.683626 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-fb687071-71be-4a1d-a023-8164fd7d7075 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:30.687740 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb5a7899-1fdb-42b6-bec0-d69e54b8f5a6] AMQP server on 10.222.0.79:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 13:27:30.693892 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-fb687071-71be-4a1d-a023-8164fd7d7075 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:30.694381 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-fb687071-71be-4a1d-a023-8164fd7d7075 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:30.695255 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-fb687071-71be-4a1d-a023-8164fd7d7075 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:30.695639 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-fb687071-71be-4a1d-a023-8164fd7d7075 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:30.903107 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-fb687071-71be-4a1d-a023-8164fd7d7075 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:30.912431 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-fb687071-71be-4a1d-a023-8164fd7d7075 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.233211 Apr 30 13:27:30.913006 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 663/1230] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:30 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:27:31.929367 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-e0918822-22fa-4365-b044-7a0f9d5ffba7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:31.929986 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-e0918822-22fa-4365-b044-7a0f9d5ffba7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:31.937230 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e0918822-22fa-4365-b044-7a0f9d5ffba7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:31.937688 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e0918822-22fa-4365-b044-7a0f9d5ffba7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:31.938526 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e0918822-22fa-4365-b044-7a0f9d5ffba7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:31.939023 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e0918822-22fa-4365-b044-7a0f9d5ffba7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:32.142940 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-e0918822-22fa-4365-b044-7a0f9d5ffba7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:32.151857 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-e0918822-22fa-4365-b044-7a0f9d5ffba7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.226730 Apr 30 13:27:32.152444 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 568/1231] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:31 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:27:33.168749 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b7a53195-d6e4-4aca-baac-12e1fbabdcca tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:33.169961 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-b7a53195-d6e4-4aca-baac-12e1fbabdcca tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:33.193162 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb5a7899-1fdb-42b6-bec0-d69e54b8f5a6] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 59154. Apr 30 13:27:33.197334 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b7a53195-d6e4-4aca-baac-12e1fbabdcca tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:33.197790 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b7a53195-d6e4-4aca-baac-12e1fbabdcca tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:33.198616 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b7a53195-d6e4-4aca-baac-12e1fbabdcca tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:33.199106 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b7a53195-d6e4-4aca-baac-12e1fbabdcca tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:33.406522 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-b7a53195-d6e4-4aca-baac-12e1fbabdcca tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:33.417275 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b7a53195-d6e4-4aca-baac-12e1fbabdcca tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.252205 Apr 30 13:27:33.417881 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 664/1232] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:33 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:27:34.434962 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-07bac07c-b36a-40eb-b948-3e7aea725816 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:34.435580 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-07bac07c-b36a-40eb-b948-3e7aea725816 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:34.443600 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-07bac07c-b36a-40eb-b948-3e7aea725816 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:34.444060 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-07bac07c-b36a-40eb-b948-3e7aea725816 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:34.444840 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-07bac07c-b36a-40eb-b948-3e7aea725816 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:34.445290 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-07bac07c-b36a-40eb-b948-3e7aea725816 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:34.641040 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-07bac07c-b36a-40eb-b948-3e7aea725816 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:34.649323 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-07bac07c-b36a-40eb-b948-3e7aea725816 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.218100 Apr 30 13:27:34.649880 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 569/1233] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:34 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:27:35.666704 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-4322d019-03de-4c39-81ed-ada7be132a68 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:35.667292 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-4322d019-03de-4c39-81ed-ada7be132a68 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:35.674869 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4322d019-03de-4c39-81ed-ada7be132a68 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:35.675329 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4322d019-03de-4c39-81ed-ada7be132a68 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:35.676743 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4322d019-03de-4c39-81ed-ada7be132a68 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:35.677344 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4322d019-03de-4c39-81ed-ada7be132a68 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:35.892111 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-4322d019-03de-4c39-81ed-ada7be132a68 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:35.901244 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-4322d019-03de-4c39-81ed-ada7be132a68 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.238273 Apr 30 13:27:35.901823 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 665/1234] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:35 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:27:36.918645 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-30655641-de17-4223-aef6-bc5c096b9a1c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:36.920550 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-30655641-de17-4223-aef6-bc5c096b9a1c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:36.927788 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-30655641-de17-4223-aef6-bc5c096b9a1c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:36.928203 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-30655641-de17-4223-aef6-bc5c096b9a1c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:36.928992 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-30655641-de17-4223-aef6-bc5c096b9a1c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:36.929428 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-30655641-de17-4223-aef6-bc5c096b9a1c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:37.129608 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-30655641-de17-4223-aef6-bc5c096b9a1c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:37.138049 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-30655641-de17-4223-aef6-bc5c096b9a1c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.223149 Apr 30 13:27:37.138628 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 570/1235] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:36 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:27:38.156291 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-ddf41da2-3af1-4dea-a6bc-b4d2defeb8ff tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:38.156845 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-ddf41da2-3af1-4dea-a6bc-b4d2defeb8ff tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:38.164460 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ddf41da2-3af1-4dea-a6bc-b4d2defeb8ff tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:38.164958 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ddf41da2-3af1-4dea-a6bc-b4d2defeb8ff tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:38.165775 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ddf41da2-3af1-4dea-a6bc-b4d2defeb8ff tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:38.166256 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ddf41da2-3af1-4dea-a6bc-b4d2defeb8ff tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:38.362236 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-ddf41da2-3af1-4dea-a6bc-b4d2defeb8ff tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:38.371304 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-ddf41da2-3af1-4dea-a6bc-b4d2defeb8ff tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.218819 Apr 30 13:27:38.371879 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 666/1236] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:38 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:27:39.388595 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-f9be4475-d06c-490f-9718-4f6c62c21603 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:39.389222 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-f9be4475-d06c-490f-9718-4f6c62c21603 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:39.398147 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f9be4475-d06c-490f-9718-4f6c62c21603 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:39.398602 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f9be4475-d06c-490f-9718-4f6c62c21603 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:39.399395 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f9be4475-d06c-490f-9718-4f6c62c21603 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:39.399839 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f9be4475-d06c-490f-9718-4f6c62c21603 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:39.874155 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-f9be4475-d06c-490f-9718-4f6c62c21603 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:39.883861 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-f9be4475-d06c-490f-9718-4f6c62c21603 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.499056 Apr 30 13:27:39.884439 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 571/1237] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:39 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:27:40.553366 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-db9e2745-f562-4fb3-a603-90dd3b0628ff tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:40.553815 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-db9e2745-f562-4fb3-a603-90dd3b0628ff tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:40.561080 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-db9e2745-f562-4fb3-a603-90dd3b0628ff tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:40.561540 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-db9e2745-f562-4fb3-a603-90dd3b0628ff tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:40.562364 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-db9e2745-f562-4fb3-a603-90dd3b0628ff tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:40.562811 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-db9e2745-f562-4fb3-a603-90dd3b0628ff tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:40.629598 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-db9e2745-f562-4fb3-a603-90dd3b0628ff tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Going to try to terminate instance {{(pid=87933) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 13:27:40.749673 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-db9e2745-f562-4fb3-a603-90dd3b0628ff tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 204 len: 0 microversion: 2.20 time: 0.199070 Apr 30 13:27:40.750758 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 667/1238] 10.222.0.79 () {60 vars in 1280 bytes} [Fri Apr 30 13:27:40 2021] DELETE /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 30 13:27:40.759509 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-6b77f6a6-9bd9-4f7f-bb8c-69883c0b03a7 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:40.760127 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-6b77f6a6-9bd9-4f7f-bb8c-69883c0b03a7 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:40.767548 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6b77f6a6-9bd9-4f7f-bb8c-69883c0b03a7 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:40.768007 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6b77f6a6-9bd9-4f7f-bb8c-69883c0b03a7 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:40.768796 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6b77f6a6-9bd9-4f7f-bb8c-69883c0b03a7 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:40.769242 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6b77f6a6-9bd9-4f7f-bb8c-69883c0b03a7 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:40.901742 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-95966749-b401-4095-90e1-3c36c656c218 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:40.902477 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-95966749-b401-4095-90e1-3c36c656c218 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:40.910193 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-95966749-b401-4095-90e1-3c36c656c218 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:40.910990 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-95966749-b401-4095-90e1-3c36c656c218 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:40.911793 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-95966749-b401-4095-90e1-3c36c656c218 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:40.912235 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-95966749-b401-4095-90e1-3c36c656c218 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:40.977077 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-6b77f6a6-9bd9-4f7f-bb8c-69883c0b03a7 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:40.986692 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-6b77f6a6-9bd9-4f7f-bb8c-69883c0b03a7 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:40.988863 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-6b77f6a6-9bd9-4f7f-bb8c-69883c0b03a7 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:40.990211 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-6b77f6a6-9bd9-4f7f-bb8c-69883c0b03a7 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1799 microversion: 2.20 time: 0.234506 Apr 30 13:27:40.990853 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 572/1239] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:27:40 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1799 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:27:41.116159 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-95966749-b401-4095-90e1-3c36c656c218 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:41.124740 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-95966749-b401-4095-90e1-3c36c656c218 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.227229 Apr 30 13:27:41.125313 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 668/1240] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:40 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:27:42.008605 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-6593d4cc-2aa0-4eaf-955c-18aab4b8d556 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:42.009225 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-6593d4cc-2aa0-4eaf-955c-18aab4b8d556 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:42.016630 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6593d4cc-2aa0-4eaf-955c-18aab4b8d556 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:42.017086 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6593d4cc-2aa0-4eaf-955c-18aab4b8d556 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:42.017872 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6593d4cc-2aa0-4eaf-955c-18aab4b8d556 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:42.018341 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6593d4cc-2aa0-4eaf-955c-18aab4b8d556 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:42.142288 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-73cdc33b-0a9e-407f-ba63-70cb1157100b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:42.142946 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-73cdc33b-0a9e-407f-ba63-70cb1157100b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:42.150347 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-73cdc33b-0a9e-407f-ba63-70cb1157100b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:42.150808 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-73cdc33b-0a9e-407f-ba63-70cb1157100b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:42.151612 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-73cdc33b-0a9e-407f-ba63-70cb1157100b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:42.152059 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-73cdc33b-0a9e-407f-ba63-70cb1157100b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:42.354763 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-73cdc33b-0a9e-407f-ba63-70cb1157100b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:42.365561 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-73cdc33b-0a9e-407f-ba63-70cb1157100b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.227368 Apr 30 13:27:42.366569 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 669/1241] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:42 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:27:42.374989 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-6593d4cc-2aa0-4eaf-955c-18aab4b8d556 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:42.385528 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-6593d4cc-2aa0-4eaf-955c-18aab4b8d556 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:42.387106 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-6593d4cc-2aa0-4eaf-955c-18aab4b8d556 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:42.388268 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-6593d4cc-2aa0-4eaf-955c-18aab4b8d556 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1799 microversion: 2.20 time: 0.383465 Apr 30 13:27:42.389122 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 573/1242] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:27:42 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1799 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:27:43.287527 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [req-e1efb7d2-2d30-4fd5-9dc3-8b3d4e77ff79 req-81f261ad-3333-4cf8-b47a-5cf5e9806049 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad3419a7-71af-4a52-bcb7-6048e0553df9", "name": "network-vif-deleted", "tag": "d3c715c3-b0fe-400d-89f5-80c09379ea24"}]} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:27:43.289207 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:27:43.289207 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: warnings.warn(msg) Apr 30 13:27:43.297557 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-e1efb7d2-2d30-4fd5-9dc3-8b3d4e77ff79 req-81f261ad-3333-4cf8-b47a-5cf5e9806049 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:43.298042 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-e1efb7d2-2d30-4fd5-9dc3-8b3d4e77ff79 req-81f261ad-3333-4cf8-b47a-5cf5e9806049 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:43.316278 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.compute.server_external_events [req-e1efb7d2-2d30-4fd5-9dc3-8b3d4e77ff79 req-81f261ad-3333-4cf8-b47a-5cf5e9806049 service nova] Creating event network-vif-deleted:d3c715c3-b0fe-400d-89f5-80c09379ea24 for instance ad3419a7-71af-4a52-bcb7-6048e0553df9 on hv-cinder-78836 Apr 30 13:27:43.322558 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [req-e1efb7d2-2d30-4fd5-9dc3-8b3d4e77ff79 req-81f261ad-3333-4cf8-b47a-5cf5e9806049 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.203381 Apr 30 13:27:43.323408 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 670/1243] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:27:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:27:43.384360 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-f01b898c-109f-445e-bd9e-d5fff2bc36d4 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:43.385005 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-f01b898c-109f-445e-bd9e-d5fff2bc36d4 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:43.392708 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f01b898c-109f-445e-bd9e-d5fff2bc36d4 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:43.393447 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f01b898c-109f-445e-bd9e-d5fff2bc36d4 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:43.394389 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f01b898c-109f-445e-bd9e-d5fff2bc36d4 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:43.395114 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f01b898c-109f-445e-bd9e-d5fff2bc36d4 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:43.411541 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-3a617f5a-dc42-4bea-986e-ef37ef8925c4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:43.412947 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-3a617f5a-dc42-4bea-986e-ef37ef8925c4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:43.422298 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3a617f5a-dc42-4bea-986e-ef37ef8925c4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:43.423083 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3a617f5a-dc42-4bea-986e-ef37ef8925c4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:43.424115 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3a617f5a-dc42-4bea-986e-ef37ef8925c4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:43.424763 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3a617f5a-dc42-4bea-986e-ef37ef8925c4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:43.563467 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-3a617f5a-dc42-4bea-986e-ef37ef8925c4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:43.574764 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-3a617f5a-dc42-4bea-986e-ef37ef8925c4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:43.576757 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-3a617f5a-dc42-4bea-986e-ef37ef8925c4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:43.578171 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-3a617f5a-dc42-4bea-986e-ef37ef8925c4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.173538 Apr 30 13:27:43.579253 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 671/1244] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:27:43 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:27:43.630357 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-f01b898c-109f-445e-bd9e-d5fff2bc36d4 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:43.641278 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-f01b898c-109f-445e-bd9e-d5fff2bc36d4 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.262080 Apr 30 13:27:43.641851 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 574/1245] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:43 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:27:44.597039 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-47ad9037-1446-47e9-8027-16226e13d40b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:44.598338 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-47ad9037-1446-47e9-8027-16226e13d40b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:44.606617 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-47ad9037-1446-47e9-8027-16226e13d40b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:44.607160 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-47ad9037-1446-47e9-8027-16226e13d40b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:44.607971 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-47ad9037-1446-47e9-8027-16226e13d40b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:44.608413 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-47ad9037-1446-47e9-8027-16226e13d40b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:44.659084 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-df3bd54b-3738-40ab-b7fc-475f059668fa tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:44.659814 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-df3bd54b-3738-40ab-b7fc-475f059668fa tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:44.668071 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-df3bd54b-3738-40ab-b7fc-475f059668fa tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:44.668546 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-df3bd54b-3738-40ab-b7fc-475f059668fa tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:44.669299 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-df3bd54b-3738-40ab-b7fc-475f059668fa tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:44.670035 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-df3bd54b-3738-40ab-b7fc-475f059668fa tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:44.728540 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-47ad9037-1446-47e9-8027-16226e13d40b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:44.738353 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-47ad9037-1446-47e9-8027-16226e13d40b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:44.739890 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-47ad9037-1446-47e9-8027-16226e13d40b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:44.741022 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-47ad9037-1446-47e9-8027-16226e13d40b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.148793 Apr 30 13:27:44.741582 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 672/1246] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:27:44 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:27:44.884827 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-df3bd54b-3738-40ab-b7fc-475f059668fa tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:44.893617 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-df3bd54b-3738-40ab-b7fc-475f059668fa tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.238242 Apr 30 13:27:44.894206 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 575/1247] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:44 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:27:45.758922 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-31ebc05d-6e3a-4ea6-bef1-75bbdc9b913f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:45.759497 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-31ebc05d-6e3a-4ea6-bef1-75bbdc9b913f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:45.766794 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-31ebc05d-6e3a-4ea6-bef1-75bbdc9b913f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:45.767238 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-31ebc05d-6e3a-4ea6-bef1-75bbdc9b913f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:45.768016 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-31ebc05d-6e3a-4ea6-bef1-75bbdc9b913f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:45.768450 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-31ebc05d-6e3a-4ea6-bef1-75bbdc9b913f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:45.888234 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-31ebc05d-6e3a-4ea6-bef1-75bbdc9b913f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:45.897640 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-31ebc05d-6e3a-4ea6-bef1-75bbdc9b913f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:45.899196 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-31ebc05d-6e3a-4ea6-bef1-75bbdc9b913f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:45.900330 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-31ebc05d-6e3a-4ea6-bef1-75bbdc9b913f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.145273 Apr 30 13:27:45.900889 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 673/1248] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:27:45 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:27:45.915562 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-3acfca6a-a4f0-4220-bf4a-c43ed15a5176 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:45.916531 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-3acfca6a-a4f0-4220-bf4a-c43ed15a5176 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:45.928280 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3acfca6a-a4f0-4220-bf4a-c43ed15a5176 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:45.928945 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3acfca6a-a4f0-4220-bf4a-c43ed15a5176 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:45.930191 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3acfca6a-a4f0-4220-bf4a-c43ed15a5176 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:45.930861 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3acfca6a-a4f0-4220-bf4a-c43ed15a5176 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:46.153491 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-3acfca6a-a4f0-4220-bf4a-c43ed15a5176 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:46.163064 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-3acfca6a-a4f0-4220-bf4a-c43ed15a5176 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.253957 Apr 30 13:27:46.163644 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 576/1249] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:45 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:27:46.917905 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-7c1be598-77a8-4a7a-b24a-b5eca4b62f33 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:46.918556 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-7c1be598-77a8-4a7a-b24a-b5eca4b62f33 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:46.926098 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7c1be598-77a8-4a7a-b24a-b5eca4b62f33 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:46.926563 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7c1be598-77a8-4a7a-b24a-b5eca4b62f33 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:46.927359 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7c1be598-77a8-4a7a-b24a-b5eca4b62f33 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:46.927802 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7c1be598-77a8-4a7a-b24a-b5eca4b62f33 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:47.048181 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-7c1be598-77a8-4a7a-b24a-b5eca4b62f33 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:47.057518 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-7c1be598-77a8-4a7a-b24a-b5eca4b62f33 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:47.059070 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-7c1be598-77a8-4a7a-b24a-b5eca4b62f33 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:47.060192 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-7c1be598-77a8-4a7a-b24a-b5eca4b62f33 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.146104 Apr 30 13:27:47.060755 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 674/1250] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:27:46 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:27:47.179935 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-4a8f9861-e286-4165-980a-b7e5d0488bb6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:47.180560 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-4a8f9861-e286-4165-980a-b7e5d0488bb6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:47.188152 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4a8f9861-e286-4165-980a-b7e5d0488bb6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:47.188632 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4a8f9861-e286-4165-980a-b7e5d0488bb6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:47.189427 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4a8f9861-e286-4165-980a-b7e5d0488bb6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:47.189872 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4a8f9861-e286-4165-980a-b7e5d0488bb6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:47.389722 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-4a8f9861-e286-4165-980a-b7e5d0488bb6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:47.398661 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-4a8f9861-e286-4165-980a-b7e5d0488bb6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.222450 Apr 30 13:27:47.399313 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 577/1251] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:47 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:27:48.078905 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-3713f82d-4e72-4379-aec2-59e143d0e5ab tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:48.079512 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-3713f82d-4e72-4379-aec2-59e143d0e5ab tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:48.087202 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3713f82d-4e72-4379-aec2-59e143d0e5ab tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:48.087650 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3713f82d-4e72-4379-aec2-59e143d0e5ab tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:48.088431 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3713f82d-4e72-4379-aec2-59e143d0e5ab tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:48.088868 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3713f82d-4e72-4379-aec2-59e143d0e5ab tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:48.202586 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-3713f82d-4e72-4379-aec2-59e143d0e5ab tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:48.212093 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-3713f82d-4e72-4379-aec2-59e143d0e5ab tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:48.213613 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-3713f82d-4e72-4379-aec2-59e143d0e5ab tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:48.214781 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-3713f82d-4e72-4379-aec2-59e143d0e5ab tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.140364 Apr 30 13:27:48.215361 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 675/1252] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:27:48 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:27:48.415975 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-1f9ddf8a-28f0-46bb-ab72-5c504e21c28d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:48.416604 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-1f9ddf8a-28f0-46bb-ab72-5c504e21c28d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:48.423994 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1f9ddf8a-28f0-46bb-ab72-5c504e21c28d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:48.424452 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1f9ddf8a-28f0-46bb-ab72-5c504e21c28d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:48.425240 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1f9ddf8a-28f0-46bb-ab72-5c504e21c28d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:48.426245 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1f9ddf8a-28f0-46bb-ab72-5c504e21c28d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:48.625414 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-1f9ddf8a-28f0-46bb-ab72-5c504e21c28d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:48.635316 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-1f9ddf8a-28f0-46bb-ab72-5c504e21c28d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.223002 Apr 30 13:27:48.635894 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 578/1253] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:48 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:27:49.232868 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-afc0c33f-9335-473b-8d55-12976f627f70 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:49.233492 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-afc0c33f-9335-473b-8d55-12976f627f70 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:49.241677 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-afc0c33f-9335-473b-8d55-12976f627f70 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:49.242174 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-afc0c33f-9335-473b-8d55-12976f627f70 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:49.242980 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-afc0c33f-9335-473b-8d55-12976f627f70 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:49.243433 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-afc0c33f-9335-473b-8d55-12976f627f70 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:49.361308 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-afc0c33f-9335-473b-8d55-12976f627f70 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:49.370774 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-afc0c33f-9335-473b-8d55-12976f627f70 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:49.372287 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-afc0c33f-9335-473b-8d55-12976f627f70 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:49.373432 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-afc0c33f-9335-473b-8d55-12976f627f70 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.144432 Apr 30 13:27:49.373994 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 676/1254] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:27:49 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:27:49.652837 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-7ec6fd26-9998-4d6a-9f58-5a9cd10118b9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:49.653386 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-7ec6fd26-9998-4d6a-9f58-5a9cd10118b9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:49.661110 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7ec6fd26-9998-4d6a-9f58-5a9cd10118b9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:49.661565 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7ec6fd26-9998-4d6a-9f58-5a9cd10118b9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:49.662372 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7ec6fd26-9998-4d6a-9f58-5a9cd10118b9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:49.662804 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7ec6fd26-9998-4d6a-9f58-5a9cd10118b9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:49.868328 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-7ec6fd26-9998-4d6a-9f58-5a9cd10118b9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:49.876633 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-7ec6fd26-9998-4d6a-9f58-5a9cd10118b9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.227560 Apr 30 13:27:49.877189 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 579/1255] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:49 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:27:50.390528 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-e5b8bca8-a0a5-4398-bf1a-7c5254a707f1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:50.391137 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-e5b8bca8-a0a5-4398-bf1a-7c5254a707f1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:50.399201 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e5b8bca8-a0a5-4398-bf1a-7c5254a707f1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:50.399649 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e5b8bca8-a0a5-4398-bf1a-7c5254a707f1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:50.400928 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e5b8bca8-a0a5-4398-bf1a-7c5254a707f1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:50.400928 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e5b8bca8-a0a5-4398-bf1a-7c5254a707f1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:50.516782 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-e5b8bca8-a0a5-4398-bf1a-7c5254a707f1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:50.526994 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-e5b8bca8-a0a5-4398-bf1a-7c5254a707f1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:50.528810 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-e5b8bca8-a0a5-4398-bf1a-7c5254a707f1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:50.529939 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-e5b8bca8-a0a5-4398-bf1a-7c5254a707f1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.143175 Apr 30 13:27:50.530546 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 677/1256] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:27:50 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:27:50.894109 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-7b08c708-1d2f-4330-9da4-229f004ce2a0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:50.894724 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-7b08c708-1d2f-4330-9da4-229f004ce2a0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:50.902123 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7b08c708-1d2f-4330-9da4-229f004ce2a0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:50.902581 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7b08c708-1d2f-4330-9da4-229f004ce2a0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:50.903360 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7b08c708-1d2f-4330-9da4-229f004ce2a0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:50.903797 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7b08c708-1d2f-4330-9da4-229f004ce2a0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:51.104623 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-7b08c708-1d2f-4330-9da4-229f004ce2a0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:51.112904 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-7b08c708-1d2f-4330-9da4-229f004ce2a0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.222552 Apr 30 13:27:51.114187 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 580/1257] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:50 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:27:51.548102 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-6513027b-4cfe-4b4b-80e9-b51e58e2dd8e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:51.548725 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-6513027b-4cfe-4b4b-80e9-b51e58e2dd8e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:51.557090 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6513027b-4cfe-4b4b-80e9-b51e58e2dd8e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:51.557543 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6513027b-4cfe-4b4b-80e9-b51e58e2dd8e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:51.558382 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6513027b-4cfe-4b4b-80e9-b51e58e2dd8e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:51.558854 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6513027b-4cfe-4b4b-80e9-b51e58e2dd8e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:51.671936 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-6513027b-4cfe-4b4b-80e9-b51e58e2dd8e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:51.682134 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-6513027b-4cfe-4b4b-80e9-b51e58e2dd8e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:51.683660 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-6513027b-4cfe-4b4b-80e9-b51e58e2dd8e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:51.684787 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-6513027b-4cfe-4b4b-80e9-b51e58e2dd8e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.140547 Apr 30 13:27:51.685345 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 678/1258] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:27:51 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:27:52.127701 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1abdcfbc-0fea-4857-8557-cdc275d2ef0c] AMQP server on 10.222.0.79:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 13:27:52.131018 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-613a7db3-b83a-44da-ad8e-c027f43d0c69 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:52.131665 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-613a7db3-b83a-44da-ad8e-c027f43d0c69 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:52.139144 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-613a7db3-b83a-44da-ad8e-c027f43d0c69 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:52.139603 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-613a7db3-b83a-44da-ad8e-c027f43d0c69 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:52.140394 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-613a7db3-b83a-44da-ad8e-c027f43d0c69 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:52.140839 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-613a7db3-b83a-44da-ad8e-c027f43d0c69 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:52.335431 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-613a7db3-b83a-44da-ad8e-c027f43d0c69 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:52.343846 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-613a7db3-b83a-44da-ad8e-c027f43d0c69 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.217668 Apr 30 13:27:52.344405 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 581/1259] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:52 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:27:52.703062 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-761aff0f-6e03-4b6c-bfb3-b5fbde6b5e89 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:52.703657 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-761aff0f-6e03-4b6c-bfb3-b5fbde6b5e89 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:52.711246 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-761aff0f-6e03-4b6c-bfb3-b5fbde6b5e89 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:52.711693 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-761aff0f-6e03-4b6c-bfb3-b5fbde6b5e89 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:52.712474 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-761aff0f-6e03-4b6c-bfb3-b5fbde6b5e89 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:52.712910 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-761aff0f-6e03-4b6c-bfb3-b5fbde6b5e89 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:52.828058 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-761aff0f-6e03-4b6c-bfb3-b5fbde6b5e89 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:52.838467 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-761aff0f-6e03-4b6c-bfb3-b5fbde6b5e89 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:52.839994 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-761aff0f-6e03-4b6c-bfb3-b5fbde6b5e89 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:52.841126 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-761aff0f-6e03-4b6c-bfb3-b5fbde6b5e89 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.141989 Apr 30 13:27:52.841949 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 679/1260] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:27:52 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:27:53.361484 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-a2e0a9fe-8a69-47d8-9ebb-52b1426814bf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:53.362249 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-a2e0a9fe-8a69-47d8-9ebb-52b1426814bf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:53.381563 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a2e0a9fe-8a69-47d8-9ebb-52b1426814bf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:53.382040 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a2e0a9fe-8a69-47d8-9ebb-52b1426814bf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:53.382844 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a2e0a9fe-8a69-47d8-9ebb-52b1426814bf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:53.383292 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a2e0a9fe-8a69-47d8-9ebb-52b1426814bf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:53.419516 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO oslo.messaging._drivers.impl_rabbit [-] [1abdcfbc-0fea-4857-8557-cdc275d2ef0c] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 59290. Apr 30 13:27:53.587096 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-a2e0a9fe-8a69-47d8-9ebb-52b1426814bf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:53.595469 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-a2e0a9fe-8a69-47d8-9ebb-52b1426814bf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.237831 Apr 30 13:27:53.596027 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 582/1261] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:53 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:27:53.860083 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-08431ea7-9df8-4b18-b23e-e17503d7ffb4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:53.860815 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-08431ea7-9df8-4b18-b23e-e17503d7ffb4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:53.869054 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-08431ea7-9df8-4b18-b23e-e17503d7ffb4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:53.869526 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-08431ea7-9df8-4b18-b23e-e17503d7ffb4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:53.870333 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-08431ea7-9df8-4b18-b23e-e17503d7ffb4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:53.870796 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-08431ea7-9df8-4b18-b23e-e17503d7ffb4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:53.986964 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-08431ea7-9df8-4b18-b23e-e17503d7ffb4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:53.997276 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-08431ea7-9df8-4b18-b23e-e17503d7ffb4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:53.998866 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-08431ea7-9df8-4b18-b23e-e17503d7ffb4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:53.999987 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-08431ea7-9df8-4b18-b23e-e17503d7ffb4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.143890 Apr 30 13:27:54.000553 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 680/1262] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:27:53 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:27:54.611721 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-ad361f52-c44b-41b4-b351-20d7001cda41 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:54.612359 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-ad361f52-c44b-41b4-b351-20d7001cda41 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:54.620399 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ad361f52-c44b-41b4-b351-20d7001cda41 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:54.620848 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ad361f52-c44b-41b4-b351-20d7001cda41 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:54.621629 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ad361f52-c44b-41b4-b351-20d7001cda41 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:54.622094 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ad361f52-c44b-41b4-b351-20d7001cda41 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:54.954331 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-ad361f52-c44b-41b4-b351-20d7001cda41 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:54.962619 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-ad361f52-c44b-41b4-b351-20d7001cda41 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.354607 Apr 30 13:27:54.963187 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 583/1263] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:54 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:27:55.021772 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-9e2c3674-ad8e-48f6-b0e5-33ad656c8788 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:55.022976 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-9e2c3674-ad8e-48f6-b0e5-33ad656c8788 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:55.036813 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9e2c3674-ad8e-48f6-b0e5-33ad656c8788 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:55.037527 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9e2c3674-ad8e-48f6-b0e5-33ad656c8788 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:55.038544 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9e2c3674-ad8e-48f6-b0e5-33ad656c8788 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:55.038987 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9e2c3674-ad8e-48f6-b0e5-33ad656c8788 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:55.157522 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-9e2c3674-ad8e-48f6-b0e5-33ad656c8788 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:55.167832 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-9e2c3674-ad8e-48f6-b0e5-33ad656c8788 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:55.169361 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-9e2c3674-ad8e-48f6-b0e5-33ad656c8788 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:55.170524 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-9e2c3674-ad8e-48f6-b0e5-33ad656c8788 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.155538 Apr 30 13:27:55.171094 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 681/1264] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:27:55 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:27:55.979799 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-d1f68942-aff7-4318-9149-bdc83601067a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:55.980417 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-d1f68942-aff7-4318-9149-bdc83601067a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:55.988052 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d1f68942-aff7-4318-9149-bdc83601067a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:55.988505 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d1f68942-aff7-4318-9149-bdc83601067a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:55.989294 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d1f68942-aff7-4318-9149-bdc83601067a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:55.989728 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d1f68942-aff7-4318-9149-bdc83601067a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:56.188486 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-d1f68942-aff7-4318-9149-bdc83601067a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:56.188807 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-31a55a7c-c073-43de-88ae-6c388b44e1ec tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:56.189426 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-31a55a7c-c073-43de-88ae-6c388b44e1ec tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:56.197580 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-31a55a7c-c073-43de-88ae-6c388b44e1ec tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:56.197759 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-d1f68942-aff7-4318-9149-bdc83601067a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.221712 Apr 30 13:27:56.198059 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-31a55a7c-c073-43de-88ae-6c388b44e1ec tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:56.198327 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 584/1265] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:55 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:27:56.198947 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-31a55a7c-c073-43de-88ae-6c388b44e1ec tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:56.199392 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-31a55a7c-c073-43de-88ae-6c388b44e1ec tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:56.317495 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-31a55a7c-c073-43de-88ae-6c388b44e1ec tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:56.326946 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-31a55a7c-c073-43de-88ae-6c388b44e1ec tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:56.328463 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-31a55a7c-c073-43de-88ae-6c388b44e1ec tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:56.329583 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-31a55a7c-c073-43de-88ae-6c388b44e1ec tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.144670 Apr 30 13:27:56.330252 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 682/1266] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:27:56 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:27:57.214997 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-9c5765e6-51db-4ec1-9220-ef96a4baf0b2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:57.215697 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-9c5765e6-51db-4ec1-9220-ef96a4baf0b2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:57.223041 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9c5765e6-51db-4ec1-9220-ef96a4baf0b2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:57.223490 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9c5765e6-51db-4ec1-9220-ef96a4baf0b2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:57.224272 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9c5765e6-51db-4ec1-9220-ef96a4baf0b2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:57.224709 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9c5765e6-51db-4ec1-9220-ef96a4baf0b2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:57.347678 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-8768e5a3-7c09-49c0-984f-0b65a3d5fd67 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:57.348353 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-8768e5a3-7c09-49c0-984f-0b65a3d5fd67 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:57.355695 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8768e5a3-7c09-49c0-984f-0b65a3d5fd67 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:57.356311 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8768e5a3-7c09-49c0-984f-0b65a3d5fd67 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:57.356940 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8768e5a3-7c09-49c0-984f-0b65a3d5fd67 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:57.357383 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8768e5a3-7c09-49c0-984f-0b65a3d5fd67 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:57.430401 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-9c5765e6-51db-4ec1-9220-ef96a4baf0b2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:57.438993 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-9c5765e6-51db-4ec1-9220-ef96a4baf0b2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.227683 Apr 30 13:27:57.439563 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 585/1267] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:57 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:27:57.538152 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-8768e5a3-7c09-49c0-984f-0b65a3d5fd67 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:57.547396 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-8768e5a3-7c09-49c0-984f-0b65a3d5fd67 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:57.548889 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-8768e5a3-7c09-49c0-984f-0b65a3d5fd67 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:57.549990 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-8768e5a3-7c09-49c0-984f-0b65a3d5fd67 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.206509 Apr 30 13:27:57.551234 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 683/1268] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:27:57 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:27:58.457092 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-e6356ff5-8852-41b6-b522-436027adde4e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:58.457826 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-e6356ff5-8852-41b6-b522-436027adde4e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:58.465776 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e6356ff5-8852-41b6-b522-436027adde4e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:58.466269 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e6356ff5-8852-41b6-b522-436027adde4e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:58.467084 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e6356ff5-8852-41b6-b522-436027adde4e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:58.467527 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e6356ff5-8852-41b6-b522-436027adde4e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:58.569637 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-91946e48-01db-412d-8939-80e6b461d600 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:58.570382 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-91946e48-01db-412d-8939-80e6b461d600 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:58.577871 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-91946e48-01db-412d-8939-80e6b461d600 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:58.578358 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-91946e48-01db-412d-8939-80e6b461d600 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:58.579154 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-91946e48-01db-412d-8939-80e6b461d600 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:58.579594 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-91946e48-01db-412d-8939-80e6b461d600 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:58.667992 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-e6356ff5-8852-41b6-b522-436027adde4e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:58.678339 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-e6356ff5-8852-41b6-b522-436027adde4e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.225430 Apr 30 13:27:58.678921 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 586/1269] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:58 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:27:58.696623 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-91946e48-01db-412d-8939-80e6b461d600 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:58.706420 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-91946e48-01db-412d-8939-80e6b461d600 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:58.709126 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-91946e48-01db-412d-8939-80e6b461d600 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:58.710281 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-91946e48-01db-412d-8939-80e6b461d600 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.144998 Apr 30 13:27:58.710844 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 684/1270] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:27:58 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:27:59.695922 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-b82a59a3-429d-4d7a-b733-aac93d063e76 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:59.696540 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-b82a59a3-429d-4d7a-b733-aac93d063e76 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:59.704011 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b82a59a3-429d-4d7a-b733-aac93d063e76 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:59.704467 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b82a59a3-429d-4d7a-b733-aac93d063e76 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:59.705264 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b82a59a3-429d-4d7a-b733-aac93d063e76 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:59.705701 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b82a59a3-429d-4d7a-b733-aac93d063e76 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:59.727462 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-bd33e00e-425e-40c9-8771-473a4760794b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:27:59.728082 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-bd33e00e-425e-40c9-8771-473a4760794b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:27:59.735643 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-bd33e00e-425e-40c9-8771-473a4760794b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:59.736103 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-bd33e00e-425e-40c9-8771-473a4760794b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:59.737001 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-bd33e00e-425e-40c9-8771-473a4760794b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:27:59.737528 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-bd33e00e-425e-40c9-8771-473a4760794b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:27:59.855996 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-bd33e00e-425e-40c9-8771-473a4760794b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:59.867503 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-bd33e00e-425e-40c9-8771-473a4760794b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:59.869022 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-bd33e00e-425e-40c9-8771-473a4760794b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:59.870183 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-bd33e00e-425e-40c9-8771-473a4760794b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.146620 Apr 30 13:27:59.870776 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 685/1271] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:27:59 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:27:59.909549 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-b82a59a3-429d-4d7a-b733-aac93d063e76 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:27:59.918184 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-b82a59a3-429d-4d7a-b733-aac93d063e76 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.225946 Apr 30 13:27:59.918749 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 587/1272] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:27:59 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:28:00.888711 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-98860daa-125d-4db1-ae99-da8d8f81d23d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:00.889359 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-98860daa-125d-4db1-ae99-da8d8f81d23d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:00.896805 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-98860daa-125d-4db1-ae99-da8d8f81d23d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:00.897258 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-98860daa-125d-4db1-ae99-da8d8f81d23d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:00.898064 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-98860daa-125d-4db1-ae99-da8d8f81d23d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:00.898514 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-98860daa-125d-4db1-ae99-da8d8f81d23d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:00.935756 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-43d06bac-f11d-4499-8856-8093f15c0535 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:00.936486 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-43d06bac-f11d-4499-8856-8093f15c0535 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:00.943896 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-43d06bac-f11d-4499-8856-8093f15c0535 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:00.944360 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-43d06bac-f11d-4499-8856-8093f15c0535 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:00.945151 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-43d06bac-f11d-4499-8856-8093f15c0535 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:00.945604 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-43d06bac-f11d-4499-8856-8093f15c0535 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:01.016230 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-98860daa-125d-4db1-ae99-da8d8f81d23d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:01.025794 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-98860daa-125d-4db1-ae99-da8d8f81d23d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:01.027356 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-98860daa-125d-4db1-ae99-da8d8f81d23d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:01.028486 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-98860daa-125d-4db1-ae99-da8d8f81d23d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.143639 Apr 30 13:28:01.029250 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 686/1273] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:28:00 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:28:01.149914 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-43d06bac-f11d-4499-8856-8093f15c0535 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:01.158129 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-43d06bac-f11d-4499-8856-8093f15c0535 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.226105 Apr 30 13:28:01.158689 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 588/1274] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:28:00 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:28:02.047358 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-cfcb645a-bf89-4805-b6c6-02326ef467f8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:02.047983 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-cfcb645a-bf89-4805-b6c6-02326ef467f8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:02.056280 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-cfcb645a-bf89-4805-b6c6-02326ef467f8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:02.056743 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-cfcb645a-bf89-4805-b6c6-02326ef467f8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:02.057531 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-cfcb645a-bf89-4805-b6c6-02326ef467f8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:02.057978 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-cfcb645a-bf89-4805-b6c6-02326ef467f8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:02.171343 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-cfcb645a-bf89-4805-b6c6-02326ef467f8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:02.175922 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-026d241b-be88-46e8-aa58-7d0512e2a1f9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:02.176772 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-026d241b-be88-46e8-aa58-7d0512e2a1f9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:02.181554 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-cfcb645a-bf89-4805-b6c6-02326ef467f8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:02.183153 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-cfcb645a-bf89-4805-b6c6-02326ef467f8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:02.184252 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-026d241b-be88-46e8-aa58-7d0512e2a1f9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:02.184987 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-cfcb645a-bf89-4805-b6c6-02326ef467f8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.140775 Apr 30 13:28:02.185168 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-026d241b-be88-46e8-aa58-7d0512e2a1f9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:02.185548 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 687/1275] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:28:02 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:28:02.185686 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-026d241b-be88-46e8-aa58-7d0512e2a1f9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:02.185979 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-026d241b-be88-46e8-aa58-7d0512e2a1f9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:02.383964 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-026d241b-be88-46e8-aa58-7d0512e2a1f9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:02.392369 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-026d241b-be88-46e8-aa58-7d0512e2a1f9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.220710 Apr 30 13:28:02.392933 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 589/1276] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:28:02 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:28:03.202835 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-1045ee9e-03fd-43b7-8666-4efebc8ce7a7 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:03.203446 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-1045ee9e-03fd-43b7-8666-4efebc8ce7a7 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:03.211526 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1045ee9e-03fd-43b7-8666-4efebc8ce7a7 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:03.211969 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1045ee9e-03fd-43b7-8666-4efebc8ce7a7 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:03.212737 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1045ee9e-03fd-43b7-8666-4efebc8ce7a7 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:03.213171 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1045ee9e-03fd-43b7-8666-4efebc8ce7a7 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:03.327922 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-1045ee9e-03fd-43b7-8666-4efebc8ce7a7 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:03.338377 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-1045ee9e-03fd-43b7-8666-4efebc8ce7a7 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:03.339940 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-1045ee9e-03fd-43b7-8666-4efebc8ce7a7 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:03.341064 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-1045ee9e-03fd-43b7-8666-4efebc8ce7a7 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.142040 Apr 30 13:28:03.341624 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 688/1277] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:28:03 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:28:03.408684 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-096642e2-793e-4735-a7ec-43ff1b57026f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:03.409456 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-096642e2-793e-4735-a7ec-43ff1b57026f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:03.417169 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-096642e2-793e-4735-a7ec-43ff1b57026f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:03.417627 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-096642e2-793e-4735-a7ec-43ff1b57026f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:03.418452 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-096642e2-793e-4735-a7ec-43ff1b57026f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:03.418898 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-096642e2-793e-4735-a7ec-43ff1b57026f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:03.620403 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-096642e2-793e-4735-a7ec-43ff1b57026f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:03.629377 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-096642e2-793e-4735-a7ec-43ff1b57026f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.223902 Apr 30 13:28:03.629958 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 590/1278] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:28:03 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:28:04.358413 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-e9f94c7e-f78c-4645-b84d-d59f6cf2f4af tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:04.359029 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-e9f94c7e-f78c-4645-b84d-d59f6cf2f4af tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:04.367126 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e9f94c7e-f78c-4645-b84d-d59f6cf2f4af tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:04.367584 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e9f94c7e-f78c-4645-b84d-d59f6cf2f4af tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:04.368369 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e9f94c7e-f78c-4645-b84d-d59f6cf2f4af tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:04.368810 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e9f94c7e-f78c-4645-b84d-d59f6cf2f4af tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:04.485695 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-e9f94c7e-f78c-4645-b84d-d59f6cf2f4af tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:04.496084 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-e9f94c7e-f78c-4645-b84d-d59f6cf2f4af tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:04.497612 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-e9f94c7e-f78c-4645-b84d-d59f6cf2f4af tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:04.498774 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-e9f94c7e-f78c-4645-b84d-d59f6cf2f4af tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.144140 Apr 30 13:28:04.499346 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 689/1279] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:28:04 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:28:04.646939 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-f27155d3-2a1a-4a15-97d0-013d09a2aa58 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:04.647491 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-f27155d3-2a1a-4a15-97d0-013d09a2aa58 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:04.654760 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f27155d3-2a1a-4a15-97d0-013d09a2aa58 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:04.655208 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f27155d3-2a1a-4a15-97d0-013d09a2aa58 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:04.655981 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f27155d3-2a1a-4a15-97d0-013d09a2aa58 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:04.656416 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f27155d3-2a1a-4a15-97d0-013d09a2aa58 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:04.857317 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-f27155d3-2a1a-4a15-97d0-013d09a2aa58 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:04.866196 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-f27155d3-2a1a-4a15-97d0-013d09a2aa58 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.223149 Apr 30 13:28:04.866950 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 591/1280] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:28:04 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:28:05.516887 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-130ccb49-9a67-4ee5-9458-872b5a6c6758 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:05.517509 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-130ccb49-9a67-4ee5-9458-872b5a6c6758 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:05.525490 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-130ccb49-9a67-4ee5-9458-872b5a6c6758 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:05.525953 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-130ccb49-9a67-4ee5-9458-872b5a6c6758 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:05.526886 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-130ccb49-9a67-4ee5-9458-872b5a6c6758 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:05.527329 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-130ccb49-9a67-4ee5-9458-872b5a6c6758 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:05.639672 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-130ccb49-9a67-4ee5-9458-872b5a6c6758 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:05.649316 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-130ccb49-9a67-4ee5-9458-872b5a6c6758 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:05.650870 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-130ccb49-9a67-4ee5-9458-872b5a6c6758 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:05.652008 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-130ccb49-9a67-4ee5-9458-872b5a6c6758 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.138966 Apr 30 13:28:05.652576 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 690/1281] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:28:05 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:28:05.883943 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-b20c2012-aade-4991-a77b-18434537fa58 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:05.884553 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-b20c2012-aade-4991-a77b-18434537fa58 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:05.891925 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b20c2012-aade-4991-a77b-18434537fa58 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:05.892373 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b20c2012-aade-4991-a77b-18434537fa58 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:05.893142 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b20c2012-aade-4991-a77b-18434537fa58 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:05.893576 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b20c2012-aade-4991-a77b-18434537fa58 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:06.091965 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-b20c2012-aade-4991-a77b-18434537fa58 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:06.100916 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-b20c2012-aade-4991-a77b-18434537fa58 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.220647 Apr 30 13:28:06.101485 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 592/1282] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:28:05 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:28:06.670370 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-35badd49-96c8-4ec1-a275-d51586412de2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:06.670992 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-35badd49-96c8-4ec1-a275-d51586412de2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:06.679264 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-35badd49-96c8-4ec1-a275-d51586412de2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:06.679755 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-35badd49-96c8-4ec1-a275-d51586412de2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:06.680551 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-35badd49-96c8-4ec1-a275-d51586412de2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:06.680997 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-35badd49-96c8-4ec1-a275-d51586412de2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:06.797955 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-35badd49-96c8-4ec1-a275-d51586412de2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:06.808295 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-35badd49-96c8-4ec1-a275-d51586412de2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:06.809811 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-35badd49-96c8-4ec1-a275-d51586412de2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:06.810962 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-35badd49-96c8-4ec1-a275-d51586412de2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.144417 Apr 30 13:28:06.811525 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 691/1283] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:28:06 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:28:07.118120 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-7a98907b-4193-4763-8088-ddf4779e3590 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:07.118657 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-7a98907b-4193-4763-8088-ddf4779e3590 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:07.126241 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7a98907b-4193-4763-8088-ddf4779e3590 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:07.126698 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7a98907b-4193-4763-8088-ddf4779e3590 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:07.127484 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7a98907b-4193-4763-8088-ddf4779e3590 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:07.127949 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7a98907b-4193-4763-8088-ddf4779e3590 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:07.328640 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-7a98907b-4193-4763-8088-ddf4779e3590 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:07.337619 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-7a98907b-4193-4763-8088-ddf4779e3590 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.223358 Apr 30 13:28:07.338220 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 593/1284] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:28:07 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:28:07.829235 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-86062a5f-6f7b-490d-b193-d09ceb4e583f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:07.829851 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-86062a5f-6f7b-490d-b193-d09ceb4e583f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:07.838028 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-86062a5f-6f7b-490d-b193-d09ceb4e583f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:07.838497 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-86062a5f-6f7b-490d-b193-d09ceb4e583f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:07.839289 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-86062a5f-6f7b-490d-b193-d09ceb4e583f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:07.839730 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-86062a5f-6f7b-490d-b193-d09ceb4e583f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:07.955727 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-86062a5f-6f7b-490d-b193-d09ceb4e583f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:07.965128 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-86062a5f-6f7b-490d-b193-d09ceb4e583f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:07.966669 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-86062a5f-6f7b-490d-b193-d09ceb4e583f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:07.967782 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-86062a5f-6f7b-490d-b193-d09ceb4e583f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.142370 Apr 30 13:28:07.968352 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 692/1285] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:28:07 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:28:08.355371 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-5a7457a0-3ae6-405c-bb89-dd5c4549dd63 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:08.355990 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-5a7457a0-3ae6-405c-bb89-dd5c4549dd63 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:08.364040 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5a7457a0-3ae6-405c-bb89-dd5c4549dd63 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:08.364496 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5a7457a0-3ae6-405c-bb89-dd5c4549dd63 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:08.365278 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5a7457a0-3ae6-405c-bb89-dd5c4549dd63 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:08.365700 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5a7457a0-3ae6-405c-bb89-dd5c4549dd63 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:08.569297 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-5a7457a0-3ae6-405c-bb89-dd5c4549dd63 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:08.577672 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-5a7457a0-3ae6-405c-bb89-dd5c4549dd63 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.226045 Apr 30 13:28:08.578298 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 594/1286] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:28:08 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:28:08.985916 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-7688c644-0983-4260-8f83-ed7277315b55 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:08.987214 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-7688c644-0983-4260-8f83-ed7277315b55 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:08.995216 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7688c644-0983-4260-8f83-ed7277315b55 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:08.995664 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7688c644-0983-4260-8f83-ed7277315b55 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:08.997202 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7688c644-0983-4260-8f83-ed7277315b55 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:08.997202 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7688c644-0983-4260-8f83-ed7277315b55 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:09.112303 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-7688c644-0983-4260-8f83-ed7277315b55 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:09.122049 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-7688c644-0983-4260-8f83-ed7277315b55 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:09.123483 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-7688c644-0983-4260-8f83-ed7277315b55 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:09.124610 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-7688c644-0983-4260-8f83-ed7277315b55 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.142633 Apr 30 13:28:09.125179 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 693/1287] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:28:08 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:28:09.595847 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-7491d019-b3bf-4b0f-92f5-4758b3e273bf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:09.596450 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-7491d019-b3bf-4b0f-92f5-4758b3e273bf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:09.603911 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7491d019-b3bf-4b0f-92f5-4758b3e273bf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:09.604371 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7491d019-b3bf-4b0f-92f5-4758b3e273bf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:09.605169 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7491d019-b3bf-4b0f-92f5-4758b3e273bf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:09.605615 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7491d019-b3bf-4b0f-92f5-4758b3e273bf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:09.809159 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-7491d019-b3bf-4b0f-92f5-4758b3e273bf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:09.817647 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-7491d019-b3bf-4b0f-92f5-4758b3e273bf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.225498 Apr 30 13:28:09.818254 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 595/1288] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:28:09 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:28:10.143570 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-11bdc442-2513-43e2-ac17-951450103951 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:10.144951 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-11bdc442-2513-43e2-ac17-951450103951 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:10.152262 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-11bdc442-2513-43e2-ac17-951450103951 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:10.152718 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-11bdc442-2513-43e2-ac17-951450103951 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:10.153503 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-11bdc442-2513-43e2-ac17-951450103951 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:10.153943 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-11bdc442-2513-43e2-ac17-951450103951 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:10.269890 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-11bdc442-2513-43e2-ac17-951450103951 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:10.279161 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-11bdc442-2513-43e2-ac17-951450103951 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:10.280670 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-11bdc442-2513-43e2-ac17-951450103951 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:10.281786 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-11bdc442-2513-43e2-ac17-951450103951 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.142087 Apr 30 13:28:10.282442 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 694/1289] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:28:10 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:28:10.835429 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-64429cda-b054-4efd-96e6-69f349625bd5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:10.836050 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-64429cda-b054-4efd-96e6-69f349625bd5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:10.843708 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-64429cda-b054-4efd-96e6-69f349625bd5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:10.844167 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-64429cda-b054-4efd-96e6-69f349625bd5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:10.844956 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-64429cda-b054-4efd-96e6-69f349625bd5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:10.845404 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-64429cda-b054-4efd-96e6-69f349625bd5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:11.045189 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-64429cda-b054-4efd-96e6-69f349625bd5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:11.054598 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-64429cda-b054-4efd-96e6-69f349625bd5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.223384 Apr 30 13:28:11.055178 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 596/1290] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:28:10 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:28:11.301911 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-910ccd8a-310f-43ab-b1ea-b14c0307a111 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:11.302685 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-910ccd8a-310f-43ab-b1ea-b14c0307a111 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:11.309985 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-910ccd8a-310f-43ab-b1ea-b14c0307a111 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:11.310474 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-910ccd8a-310f-43ab-b1ea-b14c0307a111 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:11.311260 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-910ccd8a-310f-43ab-b1ea-b14c0307a111 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:11.311701 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-910ccd8a-310f-43ab-b1ea-b14c0307a111 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:11.428415 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-910ccd8a-310f-43ab-b1ea-b14c0307a111 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:11.437644 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-910ccd8a-310f-43ab-b1ea-b14c0307a111 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:11.439675 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-910ccd8a-310f-43ab-b1ea-b14c0307a111 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:11.440996 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-910ccd8a-310f-43ab-b1ea-b14c0307a111 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.144186 Apr 30 13:28:11.441638 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 695/1291] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:28:11 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:28:12.072246 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-0259ff9b-c07e-4343-ba8d-540e1a8ce830 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:12.072858 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-0259ff9b-c07e-4343-ba8d-540e1a8ce830 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:12.080229 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0259ff9b-c07e-4343-ba8d-540e1a8ce830 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:12.080611 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0259ff9b-c07e-4343-ba8d-540e1a8ce830 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:12.082119 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0259ff9b-c07e-4343-ba8d-540e1a8ce830 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:12.082703 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0259ff9b-c07e-4343-ba8d-540e1a8ce830 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:12.291411 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-0259ff9b-c07e-4343-ba8d-540e1a8ce830 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:12.299717 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-0259ff9b-c07e-4343-ba8d-540e1a8ce830 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.231208 Apr 30 13:28:12.300290 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 597/1292] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:28:12 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:28:12.459783 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-5b8dd95c-3658-4a50-bc6d-22b12f890c19 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:12.460394 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-5b8dd95c-3658-4a50-bc6d-22b12f890c19 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:12.468258 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5b8dd95c-3658-4a50-bc6d-22b12f890c19 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:12.468722 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5b8dd95c-3658-4a50-bc6d-22b12f890c19 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:12.469515 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5b8dd95c-3658-4a50-bc6d-22b12f890c19 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:12.469963 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5b8dd95c-3658-4a50-bc6d-22b12f890c19 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:12.587149 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-5b8dd95c-3658-4a50-bc6d-22b12f890c19 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:12.596479 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-5b8dd95c-3658-4a50-bc6d-22b12f890c19 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:12.598223 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-5b8dd95c-3658-4a50-bc6d-22b12f890c19 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:12.599352 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-5b8dd95c-3658-4a50-bc6d-22b12f890c19 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.143454 Apr 30 13:28:12.599915 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 696/1293] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:28:12 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:28:13.317646 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-fb0d8581-4295-4da3-90c2-7a0ea718b199 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:13.318295 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-fb0d8581-4295-4da3-90c2-7a0ea718b199 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:13.325591 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fb0d8581-4295-4da3-90c2-7a0ea718b199 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:13.326078 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fb0d8581-4295-4da3-90c2-7a0ea718b199 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:13.326860 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fb0d8581-4295-4da3-90c2-7a0ea718b199 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:13.327305 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fb0d8581-4295-4da3-90c2-7a0ea718b199 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:13.616733 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-4e2cc2ea-aa71-47ff-882d-8719741ea19c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:13.617352 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-4e2cc2ea-aa71-47ff-882d-8719741ea19c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:13.621724 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-fb0d8581-4295-4da3-90c2-7a0ea718b199 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:13.624684 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4e2cc2ea-aa71-47ff-882d-8719741ea19c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:13.625134 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4e2cc2ea-aa71-47ff-882d-8719741ea19c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:13.625924 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4e2cc2ea-aa71-47ff-882d-8719741ea19c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:13.626394 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4e2cc2ea-aa71-47ff-882d-8719741ea19c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:13.630734 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-fb0d8581-4295-4da3-90c2-7a0ea718b199 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.317749 Apr 30 13:28:13.631562 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 598/1294] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:28:13 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:28:13.742337 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-4e2cc2ea-aa71-47ff-882d-8719741ea19c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:13.751454 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-4e2cc2ea-aa71-47ff-882d-8719741ea19c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:13.753793 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-4e2cc2ea-aa71-47ff-882d-8719741ea19c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:13.755288 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-4e2cc2ea-aa71-47ff-882d-8719741ea19c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.142449 Apr 30 13:28:13.755856 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 697/1295] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:28:13 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:28:14.648539 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-b2e1bd07-ab04-4e3d-bd00-cc9500c6d496 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:14.649223 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-b2e1bd07-ab04-4e3d-bd00-cc9500c6d496 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:14.656720 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b2e1bd07-ab04-4e3d-bd00-cc9500c6d496 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:14.657180 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b2e1bd07-ab04-4e3d-bd00-cc9500c6d496 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:14.657969 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b2e1bd07-ab04-4e3d-bd00-cc9500c6d496 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:14.658444 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b2e1bd07-ab04-4e3d-bd00-cc9500c6d496 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:14.774108 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-53f237f9-274b-481b-b8a2-092d2e111722 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:14.774730 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-53f237f9-274b-481b-b8a2-092d2e111722 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:14.782317 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-53f237f9-274b-481b-b8a2-092d2e111722 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:14.782772 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-53f237f9-274b-481b-b8a2-092d2e111722 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:14.783565 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-53f237f9-274b-481b-b8a2-092d2e111722 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:14.784005 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-53f237f9-274b-481b-b8a2-092d2e111722 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:14.863439 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-b2e1bd07-ab04-4e3d-bd00-cc9500c6d496 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:14.873112 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-b2e1bd07-ab04-4e3d-bd00-cc9500c6d496 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.228260 Apr 30 13:28:14.873899 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 599/1296] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:28:14 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:28:14.904982 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-53f237f9-274b-481b-b8a2-092d2e111722 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:14.915471 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-53f237f9-274b-481b-b8a2-092d2e111722 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:14.917022 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-53f237f9-274b-481b-b8a2-092d2e111722 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:14.918164 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-53f237f9-274b-481b-b8a2-092d2e111722 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.147954 Apr 30 13:28:14.918729 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 698/1297] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:28:14 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:28:15.890332 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-d001abf9-6345-4791-8cf0-74e86591a83d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:15.890949 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-d001abf9-6345-4791-8cf0-74e86591a83d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:15.898940 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d001abf9-6345-4791-8cf0-74e86591a83d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:15.899404 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d001abf9-6345-4791-8cf0-74e86591a83d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:15.900191 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d001abf9-6345-4791-8cf0-74e86591a83d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:15.900638 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d001abf9-6345-4791-8cf0-74e86591a83d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:15.936163 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-ccd7f46c-c88f-4459-aa24-c44c63028160 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:15.936777 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-ccd7f46c-c88f-4459-aa24-c44c63028160 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:15.944986 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ccd7f46c-c88f-4459-aa24-c44c63028160 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:15.945444 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ccd7f46c-c88f-4459-aa24-c44c63028160 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:15.946287 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ccd7f46c-c88f-4459-aa24-c44c63028160 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:15.946729 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ccd7f46c-c88f-4459-aa24-c44c63028160 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:16.060804 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-ccd7f46c-c88f-4459-aa24-c44c63028160 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:16.071434 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-ccd7f46c-c88f-4459-aa24-c44c63028160 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:16.072968 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-ccd7f46c-c88f-4459-aa24-c44c63028160 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:16.074296 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-ccd7f46c-c88f-4459-aa24-c44c63028160 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.141904 Apr 30 13:28:16.074867 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 699/1298] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:28:15 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:28:16.101338 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-d001abf9-6345-4791-8cf0-74e86591a83d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:16.109802 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-d001abf9-6345-4791-8cf0-74e86591a83d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.223166 Apr 30 13:28:16.110395 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 600/1299] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:28:15 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:28:17.092915 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-212b7fac-a83c-4e1f-8952-ad9eed539485 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:17.093687 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-212b7fac-a83c-4e1f-8952-ad9eed539485 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:17.102437 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-212b7fac-a83c-4e1f-8952-ad9eed539485 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:17.103211 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-212b7fac-a83c-4e1f-8952-ad9eed539485 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:17.104101 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-212b7fac-a83c-4e1f-8952-ad9eed539485 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:17.104602 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-212b7fac-a83c-4e1f-8952-ad9eed539485 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:17.127316 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-23e2ae7c-3767-4466-a77a-6fb1ecddc6c1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:17.127927 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-23e2ae7c-3767-4466-a77a-6fb1ecddc6c1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:17.136601 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-23e2ae7c-3767-4466-a77a-6fb1ecddc6c1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:17.137324 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-23e2ae7c-3767-4466-a77a-6fb1ecddc6c1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:17.138339 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-23e2ae7c-3767-4466-a77a-6fb1ecddc6c1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:17.138779 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-23e2ae7c-3767-4466-a77a-6fb1ecddc6c1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:17.226060 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-212b7fac-a83c-4e1f-8952-ad9eed539485 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:17.235997 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-212b7fac-a83c-4e1f-8952-ad9eed539485 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:17.237620 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-212b7fac-a83c-4e1f-8952-ad9eed539485 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:17.239091 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-212b7fac-a83c-4e1f-8952-ad9eed539485 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.150219 Apr 30 13:28:17.242043 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 700/1300] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:28:17 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:28:17.345171 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-23e2ae7c-3767-4466-a77a-6fb1ecddc6c1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:17.353467 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-23e2ae7c-3767-4466-a77a-6fb1ecddc6c1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.230139 Apr 30 13:28:17.354057 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 601/1301] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:28:17 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:28:18.258205 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-53e79ba3-8725-4bb7-887a-145098c10b42 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:18.258827 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-53e79ba3-8725-4bb7-887a-145098c10b42 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:18.266485 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-53e79ba3-8725-4bb7-887a-145098c10b42 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:18.266947 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-53e79ba3-8725-4bb7-887a-145098c10b42 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:18.267736 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-53e79ba3-8725-4bb7-887a-145098c10b42 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:18.268182 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-53e79ba3-8725-4bb7-887a-145098c10b42 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:18.370366 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-b81fc3c6-0305-4e1a-8212-2d0e5aee33df tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:18.371020 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-b81fc3c6-0305-4e1a-8212-2d0e5aee33df tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:18.378496 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b81fc3c6-0305-4e1a-8212-2d0e5aee33df tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:18.379854 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b81fc3c6-0305-4e1a-8212-2d0e5aee33df tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:18.380496 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b81fc3c6-0305-4e1a-8212-2d0e5aee33df tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:18.380943 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b81fc3c6-0305-4e1a-8212-2d0e5aee33df tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:18.387190 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-53e79ba3-8725-4bb7-887a-145098c10b42 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:18.396636 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-53e79ba3-8725-4bb7-887a-145098c10b42 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:18.398185 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-53e79ba3-8725-4bb7-887a-145098c10b42 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:18.399361 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-53e79ba3-8725-4bb7-887a-145098c10b42 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.145921 Apr 30 13:28:18.399929 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 701/1302] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:28:18 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:28:18.583086 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-b81fc3c6-0305-4e1a-8212-2d0e5aee33df tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:18.591742 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-b81fc3c6-0305-4e1a-8212-2d0e5aee33df tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.225107 Apr 30 13:28:18.592313 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 602/1303] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:28:18 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:28:19.417481 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-6f10a368-a4e8-4cb4-86d0-ebf63397546e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:19.418150 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-6f10a368-a4e8-4cb4-86d0-ebf63397546e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:19.426412 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6f10a368-a4e8-4cb4-86d0-ebf63397546e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:19.426412 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6f10a368-a4e8-4cb4-86d0-ebf63397546e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:19.427050 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6f10a368-a4e8-4cb4-86d0-ebf63397546e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:19.427497 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6f10a368-a4e8-4cb4-86d0-ebf63397546e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:19.542538 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-6f10a368-a4e8-4cb4-86d0-ebf63397546e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:19.551866 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-6f10a368-a4e8-4cb4-86d0-ebf63397546e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:19.553362 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-6f10a368-a4e8-4cb4-86d0-ebf63397546e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:19.554559 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-6f10a368-a4e8-4cb4-86d0-ebf63397546e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.140868 Apr 30 13:28:19.555133 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 702/1304] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:28:19 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:28:19.608510 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-f1cf82e9-191e-4ea6-aeeb-c1f6880eb70f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:19.609130 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-f1cf82e9-191e-4ea6-aeeb-c1f6880eb70f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:19.616590 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f1cf82e9-191e-4ea6-aeeb-c1f6880eb70f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:19.617044 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f1cf82e9-191e-4ea6-aeeb-c1f6880eb70f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:19.617822 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f1cf82e9-191e-4ea6-aeeb-c1f6880eb70f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:19.618283 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f1cf82e9-191e-4ea6-aeeb-c1f6880eb70f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:19.818745 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-f1cf82e9-191e-4ea6-aeeb-c1f6880eb70f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:19.827103 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-f1cf82e9-191e-4ea6-aeeb-c1f6880eb70f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.222281 Apr 30 13:28:19.827671 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 603/1305] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:28:19 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:28:20.572773 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-f0a656e7-37aa-4410-a283-ffb0133d66a6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:20.573390 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-f0a656e7-37aa-4410-a283-ffb0133d66a6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:20.580779 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f0a656e7-37aa-4410-a283-ffb0133d66a6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:20.581231 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f0a656e7-37aa-4410-a283-ffb0133d66a6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:20.582591 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f0a656e7-37aa-4410-a283-ffb0133d66a6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:20.583034 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f0a656e7-37aa-4410-a283-ffb0133d66a6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:20.697929 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-f0a656e7-37aa-4410-a283-ffb0133d66a6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:20.707567 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-f0a656e7-37aa-4410-a283-ffb0133d66a6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:20.709099 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-f0a656e7-37aa-4410-a283-ffb0133d66a6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:20.710249 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-f0a656e7-37aa-4410-a283-ffb0133d66a6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.141580 Apr 30 13:28:20.710803 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 703/1306] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:28:20 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:28:20.844891 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-85ce007a-e49a-4f58-a530-875d6f38934d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:20.845551 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-85ce007a-e49a-4f58-a530-875d6f38934d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:20.852993 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-85ce007a-e49a-4f58-a530-875d6f38934d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:20.853449 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-85ce007a-e49a-4f58-a530-875d6f38934d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:20.854295 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-85ce007a-e49a-4f58-a530-875d6f38934d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:20.854736 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-85ce007a-e49a-4f58-a530-875d6f38934d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:21.058080 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-85ce007a-e49a-4f58-a530-875d6f38934d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:21.066406 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-85ce007a-e49a-4f58-a530-875d6f38934d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.225577 Apr 30 13:28:21.066969 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 604/1307] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:28:20 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:28:21.727859 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-905cb3fc-7578-471c-8c87-4a3ed3d25c35 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:21.728449 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-905cb3fc-7578-471c-8c87-4a3ed3d25c35 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:21.736028 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-905cb3fc-7578-471c-8c87-4a3ed3d25c35 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:21.736490 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-905cb3fc-7578-471c-8c87-4a3ed3d25c35 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:21.737278 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-905cb3fc-7578-471c-8c87-4a3ed3d25c35 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:21.737723 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-905cb3fc-7578-471c-8c87-4a3ed3d25c35 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:21.854692 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-905cb3fc-7578-471c-8c87-4a3ed3d25c35 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:21.864238 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-905cb3fc-7578-471c-8c87-4a3ed3d25c35 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:21.865766 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-905cb3fc-7578-471c-8c87-4a3ed3d25c35 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:21.866932 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-905cb3fc-7578-471c-8c87-4a3ed3d25c35 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.142896 Apr 30 13:28:21.867496 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 704/1308] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:28:21 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:28:22.084093 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-ef4822df-4a0f-40e8-b24e-2821fb44eabc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:22.084647 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-ef4822df-4a0f-40e8-b24e-2821fb44eabc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:22.092121 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ef4822df-4a0f-40e8-b24e-2821fb44eabc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:22.092586 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ef4822df-4a0f-40e8-b24e-2821fb44eabc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:22.093376 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ef4822df-4a0f-40e8-b24e-2821fb44eabc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:22.093822 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ef4822df-4a0f-40e8-b24e-2821fb44eabc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:22.294393 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-ef4822df-4a0f-40e8-b24e-2821fb44eabc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:22.302779 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-ef4822df-4a0f-40e8-b24e-2821fb44eabc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.222998 Apr 30 13:28:22.303341 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 605/1309] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:28:22 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:28:22.885426 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-0b7e2449-fc66-4ecf-a6b2-9948dd03b0ac tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:22.886110 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-0b7e2449-fc66-4ecf-a6b2-9948dd03b0ac tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:22.893474 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0b7e2449-fc66-4ecf-a6b2-9948dd03b0ac tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:22.894157 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0b7e2449-fc66-4ecf-a6b2-9948dd03b0ac tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:22.894869 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0b7e2449-fc66-4ecf-a6b2-9948dd03b0ac tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:22.895318 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0b7e2449-fc66-4ecf-a6b2-9948dd03b0ac tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:23.009667 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-0b7e2449-fc66-4ecf-a6b2-9948dd03b0ac tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:23.019356 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-0b7e2449-fc66-4ecf-a6b2-9948dd03b0ac tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:23.020889 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-0b7e2449-fc66-4ecf-a6b2-9948dd03b0ac tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:23.022084 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-0b7e2449-fc66-4ecf-a6b2-9948dd03b0ac tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.140526 Apr 30 13:28:23.022684 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 705/1310] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:28:22 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:28:23.320694 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-1a094748-b354-447d-bf80-438af0e66b40 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:23.321313 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-1a094748-b354-447d-bf80-438af0e66b40 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:23.328719 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1a094748-b354-447d-bf80-438af0e66b40 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:23.329174 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1a094748-b354-447d-bf80-438af0e66b40 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:23.329956 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1a094748-b354-447d-bf80-438af0e66b40 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:23.330425 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1a094748-b354-447d-bf80-438af0e66b40 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:23.529991 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-1a094748-b354-447d-bf80-438af0e66b40 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:23.539313 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-1a094748-b354-447d-bf80-438af0e66b40 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.222306 Apr 30 13:28:23.539884 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 606/1311] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:28:23 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:28:24.040324 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-6d83c72f-6eab-4369-af2d-1cb1461cb312 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:24.040991 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-6d83c72f-6eab-4369-af2d-1cb1461cb312 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:24.048458 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6d83c72f-6eab-4369-af2d-1cb1461cb312 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:24.048928 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6d83c72f-6eab-4369-af2d-1cb1461cb312 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:24.049751 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6d83c72f-6eab-4369-af2d-1cb1461cb312 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:24.051122 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6d83c72f-6eab-4369-af2d-1cb1461cb312 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:24.310933 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-6d83c72f-6eab-4369-af2d-1cb1461cb312 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:24.320739 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-6d83c72f-6eab-4369-af2d-1cb1461cb312 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:24.322291 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-6d83c72f-6eab-4369-af2d-1cb1461cb312 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:24.323404 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-6d83c72f-6eab-4369-af2d-1cb1461cb312 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.287118 Apr 30 13:28:24.323954 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 706/1312] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:28:24 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:28:24.556225 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-13c37922-882e-4699-a1fd-ffef2da5c712 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:24.556849 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-13c37922-882e-4699-a1fd-ffef2da5c712 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:24.564529 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-13c37922-882e-4699-a1fd-ffef2da5c712 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:24.564921 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-13c37922-882e-4699-a1fd-ffef2da5c712 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:24.565707 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-13c37922-882e-4699-a1fd-ffef2da5c712 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:24.566908 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-13c37922-882e-4699-a1fd-ffef2da5c712 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:24.768384 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-13c37922-882e-4699-a1fd-ffef2da5c712 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:24.776787 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-13c37922-882e-4699-a1fd-ffef2da5c712 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.224266 Apr 30 13:28:24.777352 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 607/1313] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:28:24 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:28:25.341304 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-0aa9f800-7de0-41eb-abce-5bfb066ef6c5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:25.341953 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-0aa9f800-7de0-41eb-abce-5bfb066ef6c5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:25.349514 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0aa9f800-7de0-41eb-abce-5bfb066ef6c5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:25.349957 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0aa9f800-7de0-41eb-abce-5bfb066ef6c5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:25.350763 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0aa9f800-7de0-41eb-abce-5bfb066ef6c5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:25.351202 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0aa9f800-7de0-41eb-abce-5bfb066ef6c5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:25.468475 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-0aa9f800-7de0-41eb-abce-5bfb066ef6c5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:25.478997 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-0aa9f800-7de0-41eb-abce-5bfb066ef6c5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:25.480503 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-0aa9f800-7de0-41eb-abce-5bfb066ef6c5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:25.481615 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-0aa9f800-7de0-41eb-abce-5bfb066ef6c5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.144119 Apr 30 13:28:25.482272 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 707/1314] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:28:25 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:28:25.794859 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-4a33987e-35b2-4658-8234-b339d5e26857 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:25.795487 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-4a33987e-35b2-4658-8234-b339d5e26857 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:25.804126 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4a33987e-35b2-4658-8234-b339d5e26857 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:25.804580 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4a33987e-35b2-4658-8234-b339d5e26857 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:25.805371 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4a33987e-35b2-4658-8234-b339d5e26857 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:25.805814 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4a33987e-35b2-4658-8234-b339d5e26857 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:26.011036 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-4a33987e-35b2-4658-8234-b339d5e26857 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:26.019563 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-4a33987e-35b2-4658-8234-b339d5e26857 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.228374 Apr 30 13:28:26.020143 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 608/1315] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:28:25 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:28:26.500728 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-376caa13-7ebd-4ebc-bbc5-aeba4c5a7edf tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:26.501343 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-376caa13-7ebd-4ebc-bbc5-aeba4c5a7edf tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:26.508889 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-376caa13-7ebd-4ebc-bbc5-aeba4c5a7edf tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:26.509344 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-376caa13-7ebd-4ebc-bbc5-aeba4c5a7edf tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:26.510161 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-376caa13-7ebd-4ebc-bbc5-aeba4c5a7edf tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:26.510637 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-376caa13-7ebd-4ebc-bbc5-aeba4c5a7edf tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:26.631844 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-376caa13-7ebd-4ebc-bbc5-aeba4c5a7edf tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:26.641419 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-376caa13-7ebd-4ebc-bbc5-aeba4c5a7edf tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:26.642983 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-376caa13-7ebd-4ebc-bbc5-aeba4c5a7edf tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:26.644695 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-376caa13-7ebd-4ebc-bbc5-aeba4c5a7edf tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.147183 Apr 30 13:28:26.645236 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 708/1316] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:28:26 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:28:27.037528 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-5f6f89e2-f0ec-4ef0-812d-8b50c0994b40 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:27.038193 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-5f6f89e2-f0ec-4ef0-812d-8b50c0994b40 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:27.045633 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5f6f89e2-f0ec-4ef0-812d-8b50c0994b40 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:27.046129 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5f6f89e2-f0ec-4ef0-812d-8b50c0994b40 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:27.046925 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5f6f89e2-f0ec-4ef0-812d-8b50c0994b40 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:27.047371 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5f6f89e2-f0ec-4ef0-812d-8b50c0994b40 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:27.248977 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-5f6f89e2-f0ec-4ef0-812d-8b50c0994b40 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:27.258542 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-5f6f89e2-f0ec-4ef0-812d-8b50c0994b40 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.225762 Apr 30 13:28:27.259118 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 609/1317] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:28:27 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:28:27.662919 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-20b7f077-4360-4cb7-9cb2-1d4f8470fed1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:27.663520 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-20b7f077-4360-4cb7-9cb2-1d4f8470fed1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:27.671230 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-20b7f077-4360-4cb7-9cb2-1d4f8470fed1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:27.671721 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-20b7f077-4360-4cb7-9cb2-1d4f8470fed1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:27.672537 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-20b7f077-4360-4cb7-9cb2-1d4f8470fed1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:27.672986 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-20b7f077-4360-4cb7-9cb2-1d4f8470fed1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:27.792255 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-20b7f077-4360-4cb7-9cb2-1d4f8470fed1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:27.804366 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-20b7f077-4360-4cb7-9cb2-1d4f8470fed1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:27.806170 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-20b7f077-4360-4cb7-9cb2-1d4f8470fed1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:27.807301 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-20b7f077-4360-4cb7-9cb2-1d4f8470fed1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.149227 Apr 30 13:28:27.807851 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 709/1318] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:28:27 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:28:28.276485 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-a6703aee-7bfa-4a5b-9a64-61cfab094255 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:28.277162 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-a6703aee-7bfa-4a5b-9a64-61cfab094255 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:28.285425 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a6703aee-7bfa-4a5b-9a64-61cfab094255 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:28.286248 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a6703aee-7bfa-4a5b-9a64-61cfab094255 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:28.287046 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a6703aee-7bfa-4a5b-9a64-61cfab094255 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:28.287500 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a6703aee-7bfa-4a5b-9a64-61cfab094255 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:28.500264 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-a6703aee-7bfa-4a5b-9a64-61cfab094255 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:28.508671 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-a6703aee-7bfa-4a5b-9a64-61cfab094255 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.235969 Apr 30 13:28:28.509231 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 610/1319] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:28:28 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:28:28.824699 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-1eece0a8-631f-4f2e-a70e-d1d94282073b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:28.825316 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-1eece0a8-631f-4f2e-a70e-d1d94282073b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:28.833429 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1eece0a8-631f-4f2e-a70e-d1d94282073b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:28.833885 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1eece0a8-631f-4f2e-a70e-d1d94282073b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:28.834726 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1eece0a8-631f-4f2e-a70e-d1d94282073b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:28.835163 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1eece0a8-631f-4f2e-a70e-d1d94282073b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:28.952323 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-1eece0a8-631f-4f2e-a70e-d1d94282073b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:28.962706 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-1eece0a8-631f-4f2e-a70e-d1d94282073b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:28.964221 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-1eece0a8-631f-4f2e-a70e-d1d94282073b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:28.965357 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-1eece0a8-631f-4f2e-a70e-d1d94282073b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.144476 Apr 30 13:28:28.965910 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 710/1320] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:28:28 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:28:29.526323 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-6a0f97e1-70e1-4ba0-b2d9-e5d240a057c1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:29.526954 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-6a0f97e1-70e1-4ba0-b2d9-e5d240a057c1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:29.534308 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6a0f97e1-70e1-4ba0-b2d9-e5d240a057c1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:29.534762 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6a0f97e1-70e1-4ba0-b2d9-e5d240a057c1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:29.535791 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6a0f97e1-70e1-4ba0-b2d9-e5d240a057c1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:29.536234 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6a0f97e1-70e1-4ba0-b2d9-e5d240a057c1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:29.745025 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-6a0f97e1-70e1-4ba0-b2d9-e5d240a057c1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:29.754357 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-6a0f97e1-70e1-4ba0-b2d9-e5d240a057c1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.230897 Apr 30 13:28:29.754938 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 611/1321] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:28:29 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:28:29.984295 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-37785829-5198-4ec2-8ec3-084c74f22f0e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:29.984908 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-37785829-5198-4ec2-8ec3-084c74f22f0e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:29.994789 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-37785829-5198-4ec2-8ec3-084c74f22f0e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:29.995237 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-37785829-5198-4ec2-8ec3-084c74f22f0e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:29.996048 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-37785829-5198-4ec2-8ec3-084c74f22f0e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:29.996480 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-37785829-5198-4ec2-8ec3-084c74f22f0e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:30.109539 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-37785829-5198-4ec2-8ec3-084c74f22f0e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:30.119840 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-37785829-5198-4ec2-8ec3-084c74f22f0e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:30.121391 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-37785829-5198-4ec2-8ec3-084c74f22f0e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:30.122561 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-37785829-5198-4ec2-8ec3-084c74f22f0e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.142111 Apr 30 13:28:30.123120 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 711/1322] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:28:29 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:28:30.771626 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-2dcce8f3-b7b1-4b2c-86c4-00c8390d1fba tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:30.772178 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-2dcce8f3-b7b1-4b2c-86c4-00c8390d1fba tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:30.779662 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2dcce8f3-b7b1-4b2c-86c4-00c8390d1fba tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:30.780107 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2dcce8f3-b7b1-4b2c-86c4-00c8390d1fba tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:30.780898 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2dcce8f3-b7b1-4b2c-86c4-00c8390d1fba tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:30.781330 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2dcce8f3-b7b1-4b2c-86c4-00c8390d1fba tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:30.982671 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-2dcce8f3-b7b1-4b2c-86c4-00c8390d1fba tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:30.990987 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-2dcce8f3-b7b1-4b2c-86c4-00c8390d1fba tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.223210 Apr 30 13:28:30.991555 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 612/1323] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:28:30 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:28:31.142472 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-abf92f0b-2881-462a-b6b8-00958165170d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:31.143055 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-abf92f0b-2881-462a-b6b8-00958165170d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:31.154963 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-abf92f0b-2881-462a-b6b8-00958165170d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:31.155740 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-abf92f0b-2881-462a-b6b8-00958165170d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:31.157168 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-abf92f0b-2881-462a-b6b8-00958165170d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:31.157857 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-abf92f0b-2881-462a-b6b8-00958165170d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:31.282250 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-abf92f0b-2881-462a-b6b8-00958165170d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:31.291930 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-abf92f0b-2881-462a-b6b8-00958165170d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:31.293452 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-abf92f0b-2881-462a-b6b8-00958165170d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:31.294616 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-abf92f0b-2881-462a-b6b8-00958165170d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.156985 Apr 30 13:28:31.295177 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 712/1324] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:28:31 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:28:32.008183 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-c431dcc5-078c-45ee-a5fd-c012151a3d67 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:32.008804 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-c431dcc5-078c-45ee-a5fd-c012151a3d67 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:32.016309 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c431dcc5-078c-45ee-a5fd-c012151a3d67 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:32.016767 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c431dcc5-078c-45ee-a5fd-c012151a3d67 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:32.017561 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c431dcc5-078c-45ee-a5fd-c012151a3d67 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:32.018021 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c431dcc5-078c-45ee-a5fd-c012151a3d67 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:32.222612 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-c431dcc5-078c-45ee-a5fd-c012151a3d67 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:32.230990 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-c431dcc5-078c-45ee-a5fd-c012151a3d67 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.227721 Apr 30 13:28:32.231563 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 613/1325] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:28:32 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:28:32.312843 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-04c61d8c-8b2a-4765-99db-fb61081f45ae tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:32.313450 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-04c61d8c-8b2a-4765-99db-fb61081f45ae tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:32.327372 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-04c61d8c-8b2a-4765-99db-fb61081f45ae tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:32.327828 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-04c61d8c-8b2a-4765-99db-fb61081f45ae tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:32.328624 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-04c61d8c-8b2a-4765-99db-fb61081f45ae tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:32.329069 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-04c61d8c-8b2a-4765-99db-fb61081f45ae tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:32.450263 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-04c61d8c-8b2a-4765-99db-fb61081f45ae tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:32.460432 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-04c61d8c-8b2a-4765-99db-fb61081f45ae tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:32.461953 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-04c61d8c-8b2a-4765-99db-fb61081f45ae tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:32.463136 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-04c61d8c-8b2a-4765-99db-fb61081f45ae tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.154007 Apr 30 13:28:32.463684 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 713/1326] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:28:32 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:28:33.248367 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-7fab6a72-8d7c-411e-a2b3-5427097990ff tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:33.249012 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-7fab6a72-8d7c-411e-a2b3-5427097990ff tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:33.257155 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7fab6a72-8d7c-411e-a2b3-5427097990ff tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:33.257598 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7fab6a72-8d7c-411e-a2b3-5427097990ff tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:33.258406 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7fab6a72-8d7c-411e-a2b3-5427097990ff tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:33.258843 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7fab6a72-8d7c-411e-a2b3-5427097990ff tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:33.483054 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-4541ebf3-4430-4c5a-841f-90379949840d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:33.483777 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-4541ebf3-4430-4c5a-841f-90379949840d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:33.493406 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4541ebf3-4430-4c5a-841f-90379949840d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:33.493867 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4541ebf3-4430-4c5a-841f-90379949840d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:33.494717 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4541ebf3-4430-4c5a-841f-90379949840d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:33.495162 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4541ebf3-4430-4c5a-841f-90379949840d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:33.549118 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-7fab6a72-8d7c-411e-a2b3-5427097990ff tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:33.558438 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-7fab6a72-8d7c-411e-a2b3-5427097990ff tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.313685 Apr 30 13:28:33.559029 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 614/1327] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:28:33 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:28:33.609865 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-4541ebf3-4430-4c5a-841f-90379949840d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:33.619576 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-4541ebf3-4430-4c5a-841f-90379949840d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:33.621096 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-4541ebf3-4430-4c5a-841f-90379949840d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:33.622247 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-4541ebf3-4430-4c5a-841f-90379949840d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.145005 Apr 30 13:28:33.622802 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 714/1328] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:28:33 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:28:34.576733 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-0e7dd0e6-ddf7-47e4-b8c9-244e90383716 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:34.577415 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-0e7dd0e6-ddf7-47e4-b8c9-244e90383716 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:34.585719 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0e7dd0e6-ddf7-47e4-b8c9-244e90383716 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:34.586234 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0e7dd0e6-ddf7-47e4-b8c9-244e90383716 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:34.587044 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0e7dd0e6-ddf7-47e4-b8c9-244e90383716 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:34.587496 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0e7dd0e6-ddf7-47e4-b8c9-244e90383716 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:34.640775 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-8e4caa89-2fc1-44c3-a625-f4f2b5990c19 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:34.641396 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-8e4caa89-2fc1-44c3-a625-f4f2b5990c19 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:34.650033 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8e4caa89-2fc1-44c3-a625-f4f2b5990c19 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:34.650486 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8e4caa89-2fc1-44c3-a625-f4f2b5990c19 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:34.651280 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8e4caa89-2fc1-44c3-a625-f4f2b5990c19 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:34.651717 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8e4caa89-2fc1-44c3-a625-f4f2b5990c19 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:34.770573 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-8e4caa89-2fc1-44c3-a625-f4f2b5990c19 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:34.780153 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-8e4caa89-2fc1-44c3-a625-f4f2b5990c19 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:34.781658 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-8e4caa89-2fc1-44c3-a625-f4f2b5990c19 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:34.782810 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-8e4caa89-2fc1-44c3-a625-f4f2b5990c19 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.145836 Apr 30 13:28:34.783357 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 715/1329] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:28:34 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:28:34.795121 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-0e7dd0e6-ddf7-47e4-b8c9-244e90383716 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:34.803664 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-0e7dd0e6-ddf7-47e4-b8c9-244e90383716 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.230624 Apr 30 13:28:34.804322 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 615/1330] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:28:34 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:28:35.801621 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-f0c5c099-42bb-43ae-8bb0-d6deb035de8c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:35.802306 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-f0c5c099-42bb-43ae-8bb0-d6deb035de8c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:35.809872 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f0c5c099-42bb-43ae-8bb0-d6deb035de8c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:35.810374 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f0c5c099-42bb-43ae-8bb0-d6deb035de8c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:35.811168 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f0c5c099-42bb-43ae-8bb0-d6deb035de8c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:35.811615 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f0c5c099-42bb-43ae-8bb0-d6deb035de8c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:35.820666 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-5653ee28-d46a-4e00-836c-ecadfa1a2d05 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:35.821284 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-5653ee28-d46a-4e00-836c-ecadfa1a2d05 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:35.828813 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5653ee28-d46a-4e00-836c-ecadfa1a2d05 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:35.829264 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5653ee28-d46a-4e00-836c-ecadfa1a2d05 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:35.830070 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5653ee28-d46a-4e00-836c-ecadfa1a2d05 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:35.830509 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5653ee28-d46a-4e00-836c-ecadfa1a2d05 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:36.003840 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-f0c5c099-42bb-43ae-8bb0-d6deb035de8c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:36.013893 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-f0c5c099-42bb-43ae-8bb0-d6deb035de8c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:36.015442 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-f0c5c099-42bb-43ae-8bb0-d6deb035de8c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:36.016608 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-f0c5c099-42bb-43ae-8bb0-d6deb035de8c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.219471 Apr 30 13:28:36.017156 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 716/1331] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:28:35 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:28:36.038499 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-5653ee28-d46a-4e00-836c-ecadfa1a2d05 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:36.047558 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-5653ee28-d46a-4e00-836c-ecadfa1a2d05 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.230617 Apr 30 13:28:36.048153 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 616/1332] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:28:35 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:28:37.035818 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-dba97b78-6526-4f04-b168-8288e7b8ec4a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:37.036437 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-dba97b78-6526-4f04-b168-8288e7b8ec4a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:37.043923 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-dba97b78-6526-4f04-b168-8288e7b8ec4a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:37.044377 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-dba97b78-6526-4f04-b168-8288e7b8ec4a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:37.045187 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-dba97b78-6526-4f04-b168-8288e7b8ec4a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:37.045630 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-dba97b78-6526-4f04-b168-8288e7b8ec4a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:37.065109 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-0f75702f-1b29-4c1c-b7bb-c53b59135187 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:37.065918 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-0f75702f-1b29-4c1c-b7bb-c53b59135187 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:37.073754 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0f75702f-1b29-4c1c-b7bb-c53b59135187 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:37.074246 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0f75702f-1b29-4c1c-b7bb-c53b59135187 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:37.075046 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0f75702f-1b29-4c1c-b7bb-c53b59135187 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:37.075489 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0f75702f-1b29-4c1c-b7bb-c53b59135187 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:37.163466 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-dba97b78-6526-4f04-b168-8288e7b8ec4a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:37.173173 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-dba97b78-6526-4f04-b168-8288e7b8ec4a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:37.174763 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-dba97b78-6526-4f04-b168-8288e7b8ec4a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:37.175951 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-dba97b78-6526-4f04-b168-8288e7b8ec4a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.144820 Apr 30 13:28:37.176498 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 717/1333] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:28:37 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:28:37.279067 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-0f75702f-1b29-4c1c-b7bb-c53b59135187 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:37.288400 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-0f75702f-1b29-4c1c-b7bb-c53b59135187 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.226988 Apr 30 13:28:37.288979 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 617/1334] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:28:37 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:28:38.195326 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-2b22792e-0ed0-4e95-8277-60b3a5d4b75e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:38.196107 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-2b22792e-0ed0-4e95-8277-60b3a5d4b75e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:38.203492 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2b22792e-0ed0-4e95-8277-60b3a5d4b75e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:38.203935 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2b22792e-0ed0-4e95-8277-60b3a5d4b75e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:38.204719 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2b22792e-0ed0-4e95-8277-60b3a5d4b75e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:38.205155 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2b22792e-0ed0-4e95-8277-60b3a5d4b75e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:38.309466 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-6c045ec7-f620-494a-a790-210e808b5c6a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:38.310175 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-6c045ec7-f620-494a-a790-210e808b5c6a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:38.318691 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6c045ec7-f620-494a-a790-210e808b5c6a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:38.319147 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6c045ec7-f620-494a-a790-210e808b5c6a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:38.319956 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6c045ec7-f620-494a-a790-210e808b5c6a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:38.320405 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6c045ec7-f620-494a-a790-210e808b5c6a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:38.323756 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-2b22792e-0ed0-4e95-8277-60b3a5d4b75e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:38.334280 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-2b22792e-0ed0-4e95-8277-60b3a5d4b75e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:38.335798 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-2b22792e-0ed0-4e95-8277-60b3a5d4b75e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:38.336940 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-2b22792e-0ed0-4e95-8277-60b3a5d4b75e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.146523 Apr 30 13:28:38.337496 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 718/1335] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:28:38 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:28:38.522973 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-6c045ec7-f620-494a-a790-210e808b5c6a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:38.532455 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-6c045ec7-f620-494a-a790-210e808b5c6a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.231205 Apr 30 13:28:38.533038 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 618/1336] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:28:38 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:28:39.355081 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-1d4f6e9d-d15d-42f1-80ac-5569e05cb2f3 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:39.355697 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-1d4f6e9d-d15d-42f1-80ac-5569e05cb2f3 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:39.363960 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1d4f6e9d-d15d-42f1-80ac-5569e05cb2f3 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:39.364449 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1d4f6e9d-d15d-42f1-80ac-5569e05cb2f3 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:39.365248 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1d4f6e9d-d15d-42f1-80ac-5569e05cb2f3 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:39.365694 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1d4f6e9d-d15d-42f1-80ac-5569e05cb2f3 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:39.495988 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-1d4f6e9d-d15d-42f1-80ac-5569e05cb2f3 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:39.508481 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-1d4f6e9d-d15d-42f1-80ac-5569e05cb2f3 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:39.510357 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-1d4f6e9d-d15d-42f1-80ac-5569e05cb2f3 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:39.511696 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-1d4f6e9d-d15d-42f1-80ac-5569e05cb2f3 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.160300 Apr 30 13:28:39.512333 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 719/1337] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:28:39 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:28:39.550704 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-17fc294f-eb02-4874-84ea-179bd5eca458 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:39.551318 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-17fc294f-eb02-4874-84ea-179bd5eca458 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:39.559541 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-17fc294f-eb02-4874-84ea-179bd5eca458 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:39.560001 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-17fc294f-eb02-4874-84ea-179bd5eca458 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:39.560807 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-17fc294f-eb02-4874-84ea-179bd5eca458 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:39.561245 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-17fc294f-eb02-4874-84ea-179bd5eca458 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:39.777122 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-17fc294f-eb02-4874-84ea-179bd5eca458 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:39.786501 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-17fc294f-eb02-4874-84ea-179bd5eca458 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.240077 Apr 30 13:28:39.787079 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 619/1338] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:28:39 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:28:40.532126 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-3a03c773-98f1-4529-bfe5-f379e7974f6b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:40.532847 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-3a03c773-98f1-4529-bfe5-f379e7974f6b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:40.540676 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3a03c773-98f1-4529-bfe5-f379e7974f6b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:40.541134 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3a03c773-98f1-4529-bfe5-f379e7974f6b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:40.542028 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3a03c773-98f1-4529-bfe5-f379e7974f6b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:40.542481 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3a03c773-98f1-4529-bfe5-f379e7974f6b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:40.657637 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-3a03c773-98f1-4529-bfe5-f379e7974f6b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:40.667514 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-3a03c773-98f1-4529-bfe5-f379e7974f6b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:40.669029 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-3a03c773-98f1-4529-bfe5-f379e7974f6b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:40.670213 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-3a03c773-98f1-4529-bfe5-f379e7974f6b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.142078 Apr 30 13:28:40.670769 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 720/1339] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:28:40 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:28:40.804243 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-d11d5050-636e-4e3d-81b2-645486ecfa38 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:40.804806 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-d11d5050-636e-4e3d-81b2-645486ecfa38 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:40.812365 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d11d5050-636e-4e3d-81b2-645486ecfa38 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:40.812852 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d11d5050-636e-4e3d-81b2-645486ecfa38 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:40.813645 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d11d5050-636e-4e3d-81b2-645486ecfa38 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:40.814112 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d11d5050-636e-4e3d-81b2-645486ecfa38 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:41.034761 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-d11d5050-636e-4e3d-81b2-645486ecfa38 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:41.046353 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-d11d5050-636e-4e3d-81b2-645486ecfa38 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.245814 Apr 30 13:28:41.047071 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 620/1340] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:28:40 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:28:41.688174 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-c0242f99-96f1-4e0a-abca-bf4a2ed3081d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:41.688775 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-c0242f99-96f1-4e0a-abca-bf4a2ed3081d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:41.696929 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c0242f99-96f1-4e0a-abca-bf4a2ed3081d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:41.697387 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c0242f99-96f1-4e0a-abca-bf4a2ed3081d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:41.698235 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c0242f99-96f1-4e0a-abca-bf4a2ed3081d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:41.698701 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c0242f99-96f1-4e0a-abca-bf4a2ed3081d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:41.814911 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-c0242f99-96f1-4e0a-abca-bf4a2ed3081d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:41.825454 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-c0242f99-96f1-4e0a-abca-bf4a2ed3081d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:41.827000 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-c0242f99-96f1-4e0a-abca-bf4a2ed3081d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:41.828112 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-c0242f99-96f1-4e0a-abca-bf4a2ed3081d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.143755 Apr 30 13:28:41.828670 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 721/1341] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:28:41 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:28:42.118320 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-155a4cb5-ccab-4fdf-8b57-054ddf3dac24 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:42.118869 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-155a4cb5-ccab-4fdf-8b57-054ddf3dac24 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:42.126290 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-155a4cb5-ccab-4fdf-8b57-054ddf3dac24 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:42.126744 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-155a4cb5-ccab-4fdf-8b57-054ddf3dac24 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:42.127528 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-155a4cb5-ccab-4fdf-8b57-054ddf3dac24 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:42.128264 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-155a4cb5-ccab-4fdf-8b57-054ddf3dac24 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:42.328878 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-155a4cb5-ccab-4fdf-8b57-054ddf3dac24 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:42.338441 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-155a4cb5-ccab-4fdf-8b57-054ddf3dac24 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.223843 Apr 30 13:28:42.339019 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 621/1342] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:28:42 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:28:42.846184 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-ce3542b4-a861-4aae-b271-dde2984d7ee8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:42.847455 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-ce3542b4-a861-4aae-b271-dde2984d7ee8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:42.854890 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ce3542b4-a861-4aae-b271-dde2984d7ee8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:42.855345 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ce3542b4-a861-4aae-b271-dde2984d7ee8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:42.856139 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ce3542b4-a861-4aae-b271-dde2984d7ee8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:42.856578 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ce3542b4-a861-4aae-b271-dde2984d7ee8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:42.974279 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-ce3542b4-a861-4aae-b271-dde2984d7ee8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:42.983806 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-ce3542b4-a861-4aae-b271-dde2984d7ee8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:42.985325 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-ce3542b4-a861-4aae-b271-dde2984d7ee8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:42.986558 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-ce3542b4-a861-4aae-b271-dde2984d7ee8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.144283 Apr 30 13:28:42.987751 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 722/1343] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:28:42 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:28:43.355757 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-77bce9a6-1cee-4fd3-b5d0-3d21f34fb7d2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:43.356365 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-77bce9a6-1cee-4fd3-b5d0-3d21f34fb7d2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:43.363892 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-77bce9a6-1cee-4fd3-b5d0-3d21f34fb7d2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:43.364345 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-77bce9a6-1cee-4fd3-b5d0-3d21f34fb7d2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:43.365135 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-77bce9a6-1cee-4fd3-b5d0-3d21f34fb7d2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:43.365575 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-77bce9a6-1cee-4fd3-b5d0-3d21f34fb7d2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:43.569519 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-77bce9a6-1cee-4fd3-b5d0-3d21f34fb7d2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:43.578042 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-77bce9a6-1cee-4fd3-b5d0-3d21f34fb7d2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.226062 Apr 30 13:28:43.578616 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 622/1344] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:28:43 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:28:44.005255 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-e8ab19d7-a90e-4503-96bf-372f83d54d9c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:44.006118 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-e8ab19d7-a90e-4503-96bf-372f83d54d9c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:44.013781 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e8ab19d7-a90e-4503-96bf-372f83d54d9c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:44.014263 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e8ab19d7-a90e-4503-96bf-372f83d54d9c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:44.015058 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e8ab19d7-a90e-4503-96bf-372f83d54d9c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:44.015495 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e8ab19d7-a90e-4503-96bf-372f83d54d9c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:44.131781 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-e8ab19d7-a90e-4503-96bf-372f83d54d9c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:44.141393 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-e8ab19d7-a90e-4503-96bf-372f83d54d9c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:44.143019 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-e8ab19d7-a90e-4503-96bf-372f83d54d9c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:44.144562 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-e8ab19d7-a90e-4503-96bf-372f83d54d9c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.143672 Apr 30 13:28:44.145586 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 723/1345] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:28:43 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:28:44.595430 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-afd50248-e7aa-4737-9bbb-a8de96c078b1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:44.596048 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-afd50248-e7aa-4737-9bbb-a8de96c078b1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:44.604307 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-afd50248-e7aa-4737-9bbb-a8de96c078b1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:44.604814 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-afd50248-e7aa-4737-9bbb-a8de96c078b1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:44.605617 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-afd50248-e7aa-4737-9bbb-a8de96c078b1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:44.606092 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-afd50248-e7aa-4737-9bbb-a8de96c078b1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:44.809832 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-afd50248-e7aa-4737-9bbb-a8de96c078b1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:44.818648 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-afd50248-e7aa-4737-9bbb-a8de96c078b1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.226934 Apr 30 13:28:44.819218 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 623/1346] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:28:44 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:28:45.162828 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-609e9bf9-0fdf-4712-9d1e-7675fe529273 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:45.163386 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-609e9bf9-0fdf-4712-9d1e-7675fe529273 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:45.170910 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-609e9bf9-0fdf-4712-9d1e-7675fe529273 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:45.171353 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-609e9bf9-0fdf-4712-9d1e-7675fe529273 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:45.172152 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-609e9bf9-0fdf-4712-9d1e-7675fe529273 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:45.172601 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-609e9bf9-0fdf-4712-9d1e-7675fe529273 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:45.289012 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-609e9bf9-0fdf-4712-9d1e-7675fe529273 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:45.298296 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-609e9bf9-0fdf-4712-9d1e-7675fe529273 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:45.300607 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-609e9bf9-0fdf-4712-9d1e-7675fe529273 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:45.301733 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-609e9bf9-0fdf-4712-9d1e-7675fe529273 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.143925 Apr 30 13:28:45.302382 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 724/1347] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:28:45 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:28:45.836593 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-a5546cca-ea01-4dc6-a59e-2fb2550975a3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:45.837269 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-a5546cca-ea01-4dc6-a59e-2fb2550975a3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:45.844814 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a5546cca-ea01-4dc6-a59e-2fb2550975a3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:45.845272 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a5546cca-ea01-4dc6-a59e-2fb2550975a3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:45.846087 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a5546cca-ea01-4dc6-a59e-2fb2550975a3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:45.846556 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a5546cca-ea01-4dc6-a59e-2fb2550975a3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:46.048243 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-a5546cca-ea01-4dc6-a59e-2fb2550975a3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:46.056670 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-a5546cca-ea01-4dc6-a59e-2fb2550975a3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.223820 Apr 30 13:28:46.057247 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 624/1348] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:28:45 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:28:46.320182 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-f3d67851-71b7-42e6-bcff-63d6480b6a31 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:46.320812 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-f3d67851-71b7-42e6-bcff-63d6480b6a31 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:46.328257 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f3d67851-71b7-42e6-bcff-63d6480b6a31 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:46.328704 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f3d67851-71b7-42e6-bcff-63d6480b6a31 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:46.329491 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f3d67851-71b7-42e6-bcff-63d6480b6a31 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:46.329930 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f3d67851-71b7-42e6-bcff-63d6480b6a31 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:46.447167 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-f3d67851-71b7-42e6-bcff-63d6480b6a31 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:46.457056 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-f3d67851-71b7-42e6-bcff-63d6480b6a31 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:46.458588 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-f3d67851-71b7-42e6-bcff-63d6480b6a31 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:46.459712 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-f3d67851-71b7-42e6-bcff-63d6480b6a31 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.143550 Apr 30 13:28:46.460271 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 725/1349] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:28:46 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:28:47.074400 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-2e6b4ec9-d63b-4a7f-a616-80a67135fdbf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:47.074950 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-2e6b4ec9-d63b-4a7f-a616-80a67135fdbf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:47.083157 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2e6b4ec9-d63b-4a7f-a616-80a67135fdbf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:47.083621 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2e6b4ec9-d63b-4a7f-a616-80a67135fdbf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:47.084425 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2e6b4ec9-d63b-4a7f-a616-80a67135fdbf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:47.084866 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2e6b4ec9-d63b-4a7f-a616-80a67135fdbf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:47.424651 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-2e6b4ec9-d63b-4a7f-a616-80a67135fdbf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:47.433153 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-2e6b4ec9-d63b-4a7f-a616-80a67135fdbf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.362552 Apr 30 13:28:47.433733 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 625/1350] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:28:47 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:28:47.477687 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-c5706e21-eb19-4550-8344-7aebe74cdab8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:47.478332 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-c5706e21-eb19-4550-8344-7aebe74cdab8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:47.485715 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c5706e21-eb19-4550-8344-7aebe74cdab8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:47.486216 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c5706e21-eb19-4550-8344-7aebe74cdab8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:47.487056 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c5706e21-eb19-4550-8344-7aebe74cdab8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:47.487539 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c5706e21-eb19-4550-8344-7aebe74cdab8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:47.604189 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-c5706e21-eb19-4550-8344-7aebe74cdab8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:47.614121 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-c5706e21-eb19-4550-8344-7aebe74cdab8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:47.615689 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-c5706e21-eb19-4550-8344-7aebe74cdab8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:47.616829 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-c5706e21-eb19-4550-8344-7aebe74cdab8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.143108 Apr 30 13:28:47.617378 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 726/1351] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:28:47 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:28:48.450908 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-b8281ee3-78c1-4c47-9c00-1ba140a64259 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:48.451522 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-b8281ee3-78c1-4c47-9c00-1ba140a64259 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:48.459185 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b8281ee3-78c1-4c47-9c00-1ba140a64259 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:48.459636 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b8281ee3-78c1-4c47-9c00-1ba140a64259 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:48.460426 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b8281ee3-78c1-4c47-9c00-1ba140a64259 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:48.460866 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b8281ee3-78c1-4c47-9c00-1ba140a64259 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:48.634958 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-441d1c83-c509-4139-9a32-bf546d01fcb2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:48.635637 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-441d1c83-c509-4139-9a32-bf546d01fcb2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:48.642954 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-441d1c83-c509-4139-9a32-bf546d01fcb2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:48.643414 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-441d1c83-c509-4139-9a32-bf546d01fcb2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:48.644219 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-441d1c83-c509-4139-9a32-bf546d01fcb2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:48.644735 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-441d1c83-c509-4139-9a32-bf546d01fcb2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:48.666695 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-b8281ee3-78c1-4c47-9c00-1ba140a64259 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:48.675920 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-b8281ee3-78c1-4c47-9c00-1ba140a64259 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.228692 Apr 30 13:28:48.676492 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 626/1352] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:28:48 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:28:48.763302 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-441d1c83-c509-4139-9a32-bf546d01fcb2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:48.775990 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-441d1c83-c509-4139-9a32-bf546d01fcb2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:48.779197 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-441d1c83-c509-4139-9a32-bf546d01fcb2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:48.781292 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-441d1c83-c509-4139-9a32-bf546d01fcb2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.149909 Apr 30 13:28:48.782355 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 727/1353] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:28:48 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:28:49.693334 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-a0f73a07-c2b5-4caf-bdc3-63f13f71b258 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:49.693933 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-a0f73a07-c2b5-4caf-bdc3-63f13f71b258 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:49.701373 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a0f73a07-c2b5-4caf-bdc3-63f13f71b258 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:49.701825 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a0f73a07-c2b5-4caf-bdc3-63f13f71b258 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:49.702659 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a0f73a07-c2b5-4caf-bdc3-63f13f71b258 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:49.703099 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a0f73a07-c2b5-4caf-bdc3-63f13f71b258 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:49.799816 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-84db3b0c-8d80-43ca-8134-1782a055e8af tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:49.801357 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-84db3b0c-8d80-43ca-8134-1782a055e8af tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:49.809408 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-84db3b0c-8d80-43ca-8134-1782a055e8af tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:49.809858 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-84db3b0c-8d80-43ca-8134-1782a055e8af tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:49.810700 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-84db3b0c-8d80-43ca-8134-1782a055e8af tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:49.811137 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-84db3b0c-8d80-43ca-8134-1782a055e8af tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:49.907297 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-a0f73a07-c2b5-4caf-bdc3-63f13f71b258 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:49.917302 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-a0f73a07-c2b5-4caf-bdc3-63f13f71b258 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.227634 Apr 30 13:28:49.917921 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 627/1354] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:28:49 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:28:49.932040 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-84db3b0c-8d80-43ca-8134-1782a055e8af tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:49.942431 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-84db3b0c-8d80-43ca-8134-1782a055e8af tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:49.943999 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-84db3b0c-8d80-43ca-8134-1782a055e8af tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:49.945063 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-84db3b0c-8d80-43ca-8134-1782a055e8af tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.149089 Apr 30 13:28:49.945609 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 728/1355] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:28:49 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:28:50.934871 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-98b4866a-09ba-40ee-a060-42290c7c03c3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:50.935490 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-98b4866a-09ba-40ee-a060-42290c7c03c3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:50.943481 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-98b4866a-09ba-40ee-a060-42290c7c03c3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:50.943935 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-98b4866a-09ba-40ee-a060-42290c7c03c3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:50.944723 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-98b4866a-09ba-40ee-a060-42290c7c03c3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:50.945160 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-98b4866a-09ba-40ee-a060-42290c7c03c3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:50.962945 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-f6ac4229-7825-4261-85d1-8da907aae9e9 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:50.963557 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-f6ac4229-7825-4261-85d1-8da907aae9e9 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:50.971125 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f6ac4229-7825-4261-85d1-8da907aae9e9 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:50.971666 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f6ac4229-7825-4261-85d1-8da907aae9e9 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:50.972526 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f6ac4229-7825-4261-85d1-8da907aae9e9 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:50.972969 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f6ac4229-7825-4261-85d1-8da907aae9e9 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:51.095250 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-f6ac4229-7825-4261-85d1-8da907aae9e9 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:51.105471 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-f6ac4229-7825-4261-85d1-8da907aae9e9 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:51.107020 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-f6ac4229-7825-4261-85d1-8da907aae9e9 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:51.108152 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-f6ac4229-7825-4261-85d1-8da907aae9e9 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.148984 Apr 30 13:28:51.108716 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 729/1356] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:28:50 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:28:51.152954 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-98b4866a-09ba-40ee-a060-42290c7c03c3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:51.162106 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-98b4866a-09ba-40ee-a060-42290c7c03c3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.230945 Apr 30 13:28:51.162720 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 628/1357] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:28:50 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:28:52.126517 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-11e15cbb-6f24-4ffe-a2ac-5c06b574d2aa tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:52.127059 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-11e15cbb-6f24-4ffe-a2ac-5c06b574d2aa tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:52.135225 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-11e15cbb-6f24-4ffe-a2ac-5c06b574d2aa tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:52.135685 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-11e15cbb-6f24-4ffe-a2ac-5c06b574d2aa tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:52.136476 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-11e15cbb-6f24-4ffe-a2ac-5c06b574d2aa tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:52.136921 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-11e15cbb-6f24-4ffe-a2ac-5c06b574d2aa tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:52.179443 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-43f4f3df-ff29-49cd-aa6e-57d35a335e0b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:52.180047 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-43f4f3df-ff29-49cd-aa6e-57d35a335e0b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:52.187455 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-43f4f3df-ff29-49cd-aa6e-57d35a335e0b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:52.187905 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-43f4f3df-ff29-49cd-aa6e-57d35a335e0b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:52.188686 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-43f4f3df-ff29-49cd-aa6e-57d35a335e0b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:52.189116 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-43f4f3df-ff29-49cd-aa6e-57d35a335e0b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:52.255223 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-11e15cbb-6f24-4ffe-a2ac-5c06b574d2aa tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:52.264750 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-11e15cbb-6f24-4ffe-a2ac-5c06b574d2aa tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:52.266306 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-11e15cbb-6f24-4ffe-a2ac-5c06b574d2aa tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:52.267436 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-11e15cbb-6f24-4ffe-a2ac-5c06b574d2aa tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.144808 Apr 30 13:28:52.267992 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 730/1358] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:28:52 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:28:52.395884 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-43f4f3df-ff29-49cd-aa6e-57d35a335e0b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:52.404237 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-43f4f3df-ff29-49cd-aa6e-57d35a335e0b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.228457 Apr 30 13:28:52.404806 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 629/1359] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:28:52 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:28:53.285336 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-a39cb059-0a6e-4ddb-8005-463727ea82d2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:53.286210 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-a39cb059-0a6e-4ddb-8005-463727ea82d2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:53.293840 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a39cb059-0a6e-4ddb-8005-463727ea82d2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:53.294323 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a39cb059-0a6e-4ddb-8005-463727ea82d2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:53.295103 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a39cb059-0a6e-4ddb-8005-463727ea82d2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:53.295543 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a39cb059-0a6e-4ddb-8005-463727ea82d2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:53.412766 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-a39cb059-0a6e-4ddb-8005-463727ea82d2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:53.421654 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-24bf2919-534b-4a94-841a-552306aa90ec tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:53.422444 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-24bf2919-534b-4a94-841a-552306aa90ec tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:53.423012 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-a39cb059-0a6e-4ddb-8005-463727ea82d2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:53.424555 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-a39cb059-0a6e-4ddb-8005-463727ea82d2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:53.425753 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-a39cb059-0a6e-4ddb-8005-463727ea82d2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.144198 Apr 30 13:28:53.426349 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 731/1360] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:28:53 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:28:53.430393 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-24bf2919-534b-4a94-841a-552306aa90ec tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:53.430836 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-24bf2919-534b-4a94-841a-552306aa90ec tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:53.431637 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-24bf2919-534b-4a94-841a-552306aa90ec tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:53.432085 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-24bf2919-534b-4a94-841a-552306aa90ec tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:53.635014 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-24bf2919-534b-4a94-841a-552306aa90ec tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:53.643396 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-24bf2919-534b-4a94-841a-552306aa90ec tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.225379 Apr 30 13:28:53.644154 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 630/1361] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:28:53 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:28:54.444605 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-3069bd68-0579-4d4c-99b1-1a62798b9eba tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:54.445327 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-3069bd68-0579-4d4c-99b1-1a62798b9eba tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:54.452875 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3069bd68-0579-4d4c-99b1-1a62798b9eba tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:54.453324 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3069bd68-0579-4d4c-99b1-1a62798b9eba tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:54.454176 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3069bd68-0579-4d4c-99b1-1a62798b9eba tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:54.454611 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3069bd68-0579-4d4c-99b1-1a62798b9eba tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:54.574167 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-3069bd68-0579-4d4c-99b1-1a62798b9eba tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:54.584372 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-3069bd68-0579-4d4c-99b1-1a62798b9eba tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:54.585896 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-3069bd68-0579-4d4c-99b1-1a62798b9eba tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:54.587088 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-3069bd68-0579-4d4c-99b1-1a62798b9eba tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.147252 Apr 30 13:28:54.587653 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 732/1362] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:28:54 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:28:54.661788 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-37a76bd2-5cf9-46ec-ad88-643d9c125408 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:54.662452 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-37a76bd2-5cf9-46ec-ad88-643d9c125408 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:54.669925 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-37a76bd2-5cf9-46ec-ad88-643d9c125408 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:54.670402 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-37a76bd2-5cf9-46ec-ad88-643d9c125408 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:54.671183 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-37a76bd2-5cf9-46ec-ad88-643d9c125408 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:54.671619 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-37a76bd2-5cf9-46ec-ad88-643d9c125408 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:54.985441 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-37a76bd2-5cf9-46ec-ad88-643d9c125408 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:54.993963 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-37a76bd2-5cf9-46ec-ad88-643d9c125408 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.336877 Apr 30 13:28:54.994562 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 631/1363] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:28:54 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:28:55.605349 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-a1092b4c-4ea8-4034-81ca-0f1d92b6f875 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:55.605879 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-a1092b4c-4ea8-4034-81ca-0f1d92b6f875 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:55.614187 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a1092b4c-4ea8-4034-81ca-0f1d92b6f875 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:55.614651 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a1092b4c-4ea8-4034-81ca-0f1d92b6f875 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:55.615450 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a1092b4c-4ea8-4034-81ca-0f1d92b6f875 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:55.615896 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a1092b4c-4ea8-4034-81ca-0f1d92b6f875 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:55.732809 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-a1092b4c-4ea8-4034-81ca-0f1d92b6f875 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:55.742824 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-a1092b4c-4ea8-4034-81ca-0f1d92b6f875 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:55.744335 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-a1092b4c-4ea8-4034-81ca-0f1d92b6f875 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:55.745552 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-a1092b4c-4ea8-4034-81ca-0f1d92b6f875 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.144390 Apr 30 13:28:55.746123 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 733/1364] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:28:55 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:28:56.011569 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-229829af-4e54-47c7-b91f-90ae479d0276 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:56.012350 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-229829af-4e54-47c7-b91f-90ae479d0276 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:56.020379 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-229829af-4e54-47c7-b91f-90ae479d0276 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:56.020838 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-229829af-4e54-47c7-b91f-90ae479d0276 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:56.021624 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-229829af-4e54-47c7-b91f-90ae479d0276 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:56.022093 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-229829af-4e54-47c7-b91f-90ae479d0276 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:56.220025 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-229829af-4e54-47c7-b91f-90ae479d0276 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:56.229886 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-229829af-4e54-47c7-b91f-90ae479d0276 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.221993 Apr 30 13:28:56.230491 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 632/1365] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:28:56 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:28:56.763500 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-e10c7e08-51c5-46b6-99e3-541252714c8d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:56.764046 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-e10c7e08-51c5-46b6-99e3-541252714c8d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:56.772176 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e10c7e08-51c5-46b6-99e3-541252714c8d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:56.772637 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e10c7e08-51c5-46b6-99e3-541252714c8d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:56.773431 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e10c7e08-51c5-46b6-99e3-541252714c8d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:56.773902 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e10c7e08-51c5-46b6-99e3-541252714c8d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:56.891458 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-e10c7e08-51c5-46b6-99e3-541252714c8d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:56.901807 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-e10c7e08-51c5-46b6-99e3-541252714c8d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:56.903319 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-e10c7e08-51c5-46b6-99e3-541252714c8d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:56.904438 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-e10c7e08-51c5-46b6-99e3-541252714c8d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.144828 Apr 30 13:28:56.904995 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 734/1366] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:28:56 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:28:57.248021 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-2d4551de-4fc3-438d-a7fe-d00cc33c16b5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:57.248644 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-2d4551de-4fc3-438d-a7fe-d00cc33c16b5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:57.256116 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2d4551de-4fc3-438d-a7fe-d00cc33c16b5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:57.256582 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2d4551de-4fc3-438d-a7fe-d00cc33c16b5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:57.257380 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2d4551de-4fc3-438d-a7fe-d00cc33c16b5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:57.257829 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2d4551de-4fc3-438d-a7fe-d00cc33c16b5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:57.463261 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-2d4551de-4fc3-438d-a7fe-d00cc33c16b5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:57.472266 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-2d4551de-4fc3-438d-a7fe-d00cc33c16b5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.228062 Apr 30 13:28:57.472831 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 633/1367] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:28:57 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:28:57.923043 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-1e2e9458-e76a-4731-ad8b-5b52d3ce7885 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:57.923653 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-1e2e9458-e76a-4731-ad8b-5b52d3ce7885 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:57.931963 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1e2e9458-e76a-4731-ad8b-5b52d3ce7885 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:57.932418 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1e2e9458-e76a-4731-ad8b-5b52d3ce7885 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:57.933201 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1e2e9458-e76a-4731-ad8b-5b52d3ce7885 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:57.933638 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1e2e9458-e76a-4731-ad8b-5b52d3ce7885 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:58.046964 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-1e2e9458-e76a-4731-ad8b-5b52d3ce7885 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:58.057403 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-1e2e9458-e76a-4731-ad8b-5b52d3ce7885 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:58.059015 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-1e2e9458-e76a-4731-ad8b-5b52d3ce7885 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:58.060123 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-1e2e9458-e76a-4731-ad8b-5b52d3ce7885 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.140868 Apr 30 13:28:58.060676 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 735/1368] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:28:57 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:28:58.489179 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-712458d3-bf05-4a47-828e-a6b88d836e8f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:58.489983 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-712458d3-bf05-4a47-828e-a6b88d836e8f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:58.497307 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-712458d3-bf05-4a47-828e-a6b88d836e8f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:58.497753 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-712458d3-bf05-4a47-828e-a6b88d836e8f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:58.498571 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-712458d3-bf05-4a47-828e-a6b88d836e8f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:58.499001 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-712458d3-bf05-4a47-828e-a6b88d836e8f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:58.698384 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-712458d3-bf05-4a47-828e-a6b88d836e8f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:58.711096 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-712458d3-bf05-4a47-828e-a6b88d836e8f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.225809 Apr 30 13:28:58.711750 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 634/1369] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:28:58 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:28:59.078264 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-137c9025-2cd8-4952-b208-cd3acc95a03f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:59.078804 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-137c9025-2cd8-4952-b208-cd3acc95a03f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:59.087004 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-137c9025-2cd8-4952-b208-cd3acc95a03f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:59.087458 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-137c9025-2cd8-4952-b208-cd3acc95a03f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:59.088286 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-137c9025-2cd8-4952-b208-cd3acc95a03f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:59.088730 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-137c9025-2cd8-4952-b208-cd3acc95a03f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:59.207076 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-137c9025-2cd8-4952-b208-cd3acc95a03f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:59.216363 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-137c9025-2cd8-4952-b208-cd3acc95a03f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:59.217867 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-137c9025-2cd8-4952-b208-cd3acc95a03f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:59.219018 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-137c9025-2cd8-4952-b208-cd3acc95a03f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.144724 Apr 30 13:28:59.219579 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 736/1370] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:28:59 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:28:59.736541 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-96a105ad-4aae-4fe2-b9c1-c474cf4f99dc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:28:59.737800 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-96a105ad-4aae-4fe2-b9c1-c474cf4f99dc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:28:59.745347 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-96a105ad-4aae-4fe2-b9c1-c474cf4f99dc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:59.745809 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-96a105ad-4aae-4fe2-b9c1-c474cf4f99dc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:59.746652 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-96a105ad-4aae-4fe2-b9c1-c474cf4f99dc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:28:59.747094 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-96a105ad-4aae-4fe2-b9c1-c474cf4f99dc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:28:59.950796 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-96a105ad-4aae-4fe2-b9c1-c474cf4f99dc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:28:59.959323 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-96a105ad-4aae-4fe2-b9c1-c474cf4f99dc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.226645 Apr 30 13:28:59.959903 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 635/1371] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:28:59 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:29:00.236832 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-10b4768b-d771-4dcb-8dc4-c488e69f35d4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:00.237501 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-10b4768b-d771-4dcb-8dc4-c488e69f35d4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:00.246440 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-10b4768b-d771-4dcb-8dc4-c488e69f35d4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:00.246923 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-10b4768b-d771-4dcb-8dc4-c488e69f35d4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:00.247735 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-10b4768b-d771-4dcb-8dc4-c488e69f35d4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:00.248236 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-10b4768b-d771-4dcb-8dc4-c488e69f35d4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:00.366450 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-10b4768b-d771-4dcb-8dc4-c488e69f35d4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:00.375736 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-10b4768b-d771-4dcb-8dc4-c488e69f35d4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:00.377908 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-10b4768b-d771-4dcb-8dc4-c488e69f35d4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:00.379151 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-10b4768b-d771-4dcb-8dc4-c488e69f35d4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.146245 Apr 30 13:29:00.379712 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 737/1372] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:29:00 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:29:00.977105 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-e98cb766-2c03-4a6c-8908-0ee64151c236 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:00.977757 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-e98cb766-2c03-4a6c-8908-0ee64151c236 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:00.985628 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e98cb766-2c03-4a6c-8908-0ee64151c236 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:00.986104 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e98cb766-2c03-4a6c-8908-0ee64151c236 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:00.987522 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e98cb766-2c03-4a6c-8908-0ee64151c236 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:00.988115 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e98cb766-2c03-4a6c-8908-0ee64151c236 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:01.191527 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-e98cb766-2c03-4a6c-8908-0ee64151c236 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:01.199867 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-e98cb766-2c03-4a6c-8908-0ee64151c236 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.226520 Apr 30 13:29:01.200427 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 636/1373] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:00 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:29:01.397326 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-d9729720-46fb-42f7-ba46-4d478e4334c1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:01.397875 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-d9729720-46fb-42f7-ba46-4d478e4334c1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:01.405453 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d9729720-46fb-42f7-ba46-4d478e4334c1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:01.405908 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d9729720-46fb-42f7-ba46-4d478e4334c1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:01.406725 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d9729720-46fb-42f7-ba46-4d478e4334c1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:01.407170 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d9729720-46fb-42f7-ba46-4d478e4334c1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:01.522877 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-d9729720-46fb-42f7-ba46-4d478e4334c1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:01.532223 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-d9729720-46fb-42f7-ba46-4d478e4334c1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:01.533989 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-d9729720-46fb-42f7-ba46-4d478e4334c1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:01.535264 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-d9729720-46fb-42f7-ba46-4d478e4334c1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.142387 Apr 30 13:29:01.536081 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 738/1374] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:29:01 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:29:02.217879 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-358183e1-0516-4af5-aefa-1cc1884eadbc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:02.218581 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-358183e1-0516-4af5-aefa-1cc1884eadbc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:02.226197 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-358183e1-0516-4af5-aefa-1cc1884eadbc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:02.226659 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-358183e1-0516-4af5-aefa-1cc1884eadbc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:02.227448 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-358183e1-0516-4af5-aefa-1cc1884eadbc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:02.227886 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-358183e1-0516-4af5-aefa-1cc1884eadbc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:02.424963 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-358183e1-0516-4af5-aefa-1cc1884eadbc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:02.433962 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-358183e1-0516-4af5-aefa-1cc1884eadbc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.219703 Apr 30 13:29:02.434651 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 637/1375] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:02 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:29:02.553451 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-f65e0a75-f864-4f2a-901a-c91518db4c6b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:02.554001 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-f65e0a75-f864-4f2a-901a-c91518db4c6b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:02.561448 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f65e0a75-f864-4f2a-901a-c91518db4c6b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:02.561901 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f65e0a75-f864-4f2a-901a-c91518db4c6b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:02.562743 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f65e0a75-f864-4f2a-901a-c91518db4c6b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:02.563187 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f65e0a75-f864-4f2a-901a-c91518db4c6b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:02.682682 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-f65e0a75-f864-4f2a-901a-c91518db4c6b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:02.692604 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-f65e0a75-f864-4f2a-901a-c91518db4c6b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:02.694245 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-f65e0a75-f864-4f2a-901a-c91518db4c6b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:02.695399 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-f65e0a75-f864-4f2a-901a-c91518db4c6b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.145838 Apr 30 13:29:02.695956 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 739/1376] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:29:02 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:29:03.452188 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-0c5008c7-75c7-46f2-9568-c830cb231117 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:03.452860 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-0c5008c7-75c7-46f2-9568-c830cb231117 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:03.461045 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0c5008c7-75c7-46f2-9568-c830cb231117 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:03.461609 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0c5008c7-75c7-46f2-9568-c830cb231117 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:03.462438 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0c5008c7-75c7-46f2-9568-c830cb231117 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:03.462889 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0c5008c7-75c7-46f2-9568-c830cb231117 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:03.683566 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-0c5008c7-75c7-46f2-9568-c830cb231117 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:03.692790 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-0c5008c7-75c7-46f2-9568-c830cb231117 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.244426 Apr 30 13:29:03.693361 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 638/1377] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:03 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:29:03.713637 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-0e65ed66-7e04-4ff3-acd9-c27629ddf631 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:03.714252 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-0e65ed66-7e04-4ff3-acd9-c27629ddf631 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:03.721941 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0e65ed66-7e04-4ff3-acd9-c27629ddf631 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:03.722431 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0e65ed66-7e04-4ff3-acd9-c27629ddf631 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:03.723230 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0e65ed66-7e04-4ff3-acd9-c27629ddf631 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:03.723674 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0e65ed66-7e04-4ff3-acd9-c27629ddf631 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:03.844243 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-0e65ed66-7e04-4ff3-acd9-c27629ddf631 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:03.854541 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-0e65ed66-7e04-4ff3-acd9-c27629ddf631 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:03.856051 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-0e65ed66-7e04-4ff3-acd9-c27629ddf631 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:03.857169 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-0e65ed66-7e04-4ff3-acd9-c27629ddf631 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.147342 Apr 30 13:29:03.857722 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 740/1378] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:29:03 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:29:04.710839 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-01af895d-5273-429b-89bf-1a2dec876746 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:04.711478 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-01af895d-5273-429b-89bf-1a2dec876746 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:04.719529 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-01af895d-5273-429b-89bf-1a2dec876746 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:04.720054 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-01af895d-5273-429b-89bf-1a2dec876746 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:04.721599 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-01af895d-5273-429b-89bf-1a2dec876746 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:04.722231 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-01af895d-5273-429b-89bf-1a2dec876746 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:04.876597 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-20157eb5-0817-4dd6-8e97-308e76e3cff1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:04.877521 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-20157eb5-0817-4dd6-8e97-308e76e3cff1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:04.885389 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-20157eb5-0817-4dd6-8e97-308e76e3cff1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:04.886137 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-20157eb5-0817-4dd6-8e97-308e76e3cff1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:04.887129 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-20157eb5-0817-4dd6-8e97-308e76e3cff1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:04.887584 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-20157eb5-0817-4dd6-8e97-308e76e3cff1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:04.926693 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-01af895d-5273-429b-89bf-1a2dec876746 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:04.935254 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-01af895d-5273-429b-89bf-1a2dec876746 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.228678 Apr 30 13:29:04.935822 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 639/1379] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:04 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:29:05.004265 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-20157eb5-0817-4dd6-8e97-308e76e3cff1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:05.013697 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-20157eb5-0817-4dd6-8e97-308e76e3cff1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:05.015289 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-20157eb5-0817-4dd6-8e97-308e76e3cff1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:05.016401 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-20157eb5-0817-4dd6-8e97-308e76e3cff1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.143573 Apr 30 13:29:05.016964 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 741/1380] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:29:04 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:29:05.953120 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-d461530f-d39e-43a2-b6b1-75c73dbadaa3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:05.953720 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-d461530f-d39e-43a2-b6b1-75c73dbadaa3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:05.961382 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d461530f-d39e-43a2-b6b1-75c73dbadaa3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:05.961834 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d461530f-d39e-43a2-b6b1-75c73dbadaa3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:05.962661 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d461530f-d39e-43a2-b6b1-75c73dbadaa3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:05.963130 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d461530f-d39e-43a2-b6b1-75c73dbadaa3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:06.035441 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-1d9bb7ab-cec6-49cb-855d-d6d9ca489027 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:06.036360 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-1d9bb7ab-cec6-49cb-855d-d6d9ca489027 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:06.043814 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1d9bb7ab-cec6-49cb-855d-d6d9ca489027 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:06.044273 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1d9bb7ab-cec6-49cb-855d-d6d9ca489027 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:06.045064 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1d9bb7ab-cec6-49cb-855d-d6d9ca489027 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:06.045504 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1d9bb7ab-cec6-49cb-855d-d6d9ca489027 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:06.167510 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-1d9bb7ab-cec6-49cb-855d-d6d9ca489027 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:06.177610 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-1d9bb7ab-cec6-49cb-855d-d6d9ca489027 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:06.179200 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-1d9bb7ab-cec6-49cb-855d-d6d9ca489027 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:06.180335 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-1d9bb7ab-cec6-49cb-855d-d6d9ca489027 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.149339 Apr 30 13:29:06.180903 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 742/1381] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:29:06 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:29:06.265420 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-d461530f-d39e-43a2-b6b1-75c73dbadaa3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:06.274610 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-d461530f-d39e-43a2-b6b1-75c73dbadaa3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.325233 Apr 30 13:29:06.275191 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 640/1382] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:05 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:29:07.198601 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-4a09f9c9-0a17-4963-8180-4ce37247651f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:07.199276 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-4a09f9c9-0a17-4963-8180-4ce37247651f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:07.206728 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4a09f9c9-0a17-4963-8180-4ce37247651f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:07.207188 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4a09f9c9-0a17-4963-8180-4ce37247651f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:07.207981 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4a09f9c9-0a17-4963-8180-4ce37247651f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:07.208419 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4a09f9c9-0a17-4963-8180-4ce37247651f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:07.292032 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-5d5f781b-3f83-4e35-96b3-48caa9a1d687 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:07.292655 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-5d5f781b-3f83-4e35-96b3-48caa9a1d687 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:07.300817 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5d5f781b-3f83-4e35-96b3-48caa9a1d687 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:07.301253 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5d5f781b-3f83-4e35-96b3-48caa9a1d687 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:07.302055 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5d5f781b-3f83-4e35-96b3-48caa9a1d687 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:07.302493 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5d5f781b-3f83-4e35-96b3-48caa9a1d687 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:07.328871 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-4a09f9c9-0a17-4963-8180-4ce37247651f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:07.339278 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-4a09f9c9-0a17-4963-8180-4ce37247651f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:07.340787 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-4a09f9c9-0a17-4963-8180-4ce37247651f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:07.341905 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-4a09f9c9-0a17-4963-8180-4ce37247651f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.147048 Apr 30 13:29:07.342488 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 743/1383] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:29:07 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:29:07.513790 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-5d5f781b-3f83-4e35-96b3-48caa9a1d687 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:07.522531 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-5d5f781b-3f83-4e35-96b3-48caa9a1d687 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.234206 Apr 30 13:29:07.523096 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 641/1384] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:07 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:29:08.361555 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-66177062-0982-475d-9274-5dbc0b50dffb tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:08.362358 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-66177062-0982-475d-9274-5dbc0b50dffb tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:08.369842 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-66177062-0982-475d-9274-5dbc0b50dffb tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:08.370339 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-66177062-0982-475d-9274-5dbc0b50dffb tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:08.371190 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-66177062-0982-475d-9274-5dbc0b50dffb tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:08.371637 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-66177062-0982-475d-9274-5dbc0b50dffb tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:08.490350 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-66177062-0982-475d-9274-5dbc0b50dffb tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:08.500337 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-66177062-0982-475d-9274-5dbc0b50dffb tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:08.501834 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-66177062-0982-475d-9274-5dbc0b50dffb tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:08.503637 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-66177062-0982-475d-9274-5dbc0b50dffb tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.145976 Apr 30 13:29:08.504198 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 744/1385] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:29:08 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:29:08.540330 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-35cf7c11-f4bf-416d-815e-a7ffa5b5cf02 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:08.540972 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-35cf7c11-f4bf-416d-815e-a7ffa5b5cf02 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:08.548584 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-35cf7c11-f4bf-416d-815e-a7ffa5b5cf02 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:08.549059 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-35cf7c11-f4bf-416d-815e-a7ffa5b5cf02 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:08.549993 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-35cf7c11-f4bf-416d-815e-a7ffa5b5cf02 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:08.550465 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-35cf7c11-f4bf-416d-815e-a7ffa5b5cf02 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:08.750844 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-35cf7c11-f4bf-416d-815e-a7ffa5b5cf02 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:08.765548 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-35cf7c11-f4bf-416d-815e-a7ffa5b5cf02 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.228945 Apr 30 13:29:08.766165 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 642/1386] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:08 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:29:09.520782 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-4d75a297-4898-450e-8309-30a1edff8228 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:09.521403 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-4d75a297-4898-450e-8309-30a1edff8228 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:09.528860 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4d75a297-4898-450e-8309-30a1edff8228 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:09.529310 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4d75a297-4898-450e-8309-30a1edff8228 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:09.530111 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4d75a297-4898-450e-8309-30a1edff8228 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:09.530549 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4d75a297-4898-450e-8309-30a1edff8228 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:09.648075 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-4d75a297-4898-450e-8309-30a1edff8228 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:09.657768 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-4d75a297-4898-450e-8309-30a1edff8228 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:09.659379 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-4d75a297-4898-450e-8309-30a1edff8228 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:09.660504 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-4d75a297-4898-450e-8309-30a1edff8228 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.143629 Apr 30 13:29:09.661314 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 745/1387] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:29:09 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:29:09.783032 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-ac29cd6b-f999-48b5-8083-7909460cece0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:09.784454 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-ac29cd6b-f999-48b5-8083-7909460cece0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:09.791966 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ac29cd6b-f999-48b5-8083-7909460cece0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:09.792418 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ac29cd6b-f999-48b5-8083-7909460cece0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:09.793202 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ac29cd6b-f999-48b5-8083-7909460cece0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:09.793644 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ac29cd6b-f999-48b5-8083-7909460cece0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:09.999727 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-ac29cd6b-f999-48b5-8083-7909460cece0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:10.008799 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-ac29cd6b-f999-48b5-8083-7909460cece0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.229593 Apr 30 13:29:10.009377 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 643/1388] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:09 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:29:10.678512 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-3adbc102-524f-42ca-946c-bd2ceef6e1cd tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:10.679104 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-3adbc102-524f-42ca-946c-bd2ceef6e1cd tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:10.686492 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3adbc102-524f-42ca-946c-bd2ceef6e1cd tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:10.686942 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3adbc102-524f-42ca-946c-bd2ceef6e1cd tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:10.687722 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3adbc102-524f-42ca-946c-bd2ceef6e1cd tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:10.688162 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3adbc102-524f-42ca-946c-bd2ceef6e1cd tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:10.806604 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-3adbc102-524f-42ca-946c-bd2ceef6e1cd tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:10.816686 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-3adbc102-524f-42ca-946c-bd2ceef6e1cd tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:10.818222 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-3adbc102-524f-42ca-946c-bd2ceef6e1cd tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:10.819375 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-3adbc102-524f-42ca-946c-bd2ceef6e1cd tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.145365 Apr 30 13:29:10.819941 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 746/1389] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:29:10 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:29:11.026619 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-0980f221-239a-4feb-aa1b-4653d64e2f95 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:11.027241 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-0980f221-239a-4feb-aa1b-4653d64e2f95 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:11.035305 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0980f221-239a-4feb-aa1b-4653d64e2f95 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:11.036020 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0980f221-239a-4feb-aa1b-4653d64e2f95 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:11.036807 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0980f221-239a-4feb-aa1b-4653d64e2f95 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:11.037253 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0980f221-239a-4feb-aa1b-4653d64e2f95 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:11.240479 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-0980f221-239a-4feb-aa1b-4653d64e2f95 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:11.248946 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-0980f221-239a-4feb-aa1b-4653d64e2f95 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.226079 Apr 30 13:29:11.249510 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 644/1390] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:11 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:29:11.838081 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-586f0b8d-e267-4196-b0b0-2a4cf5085d0a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:11.838694 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-586f0b8d-e267-4196-b0b0-2a4cf5085d0a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:11.846745 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-586f0b8d-e267-4196-b0b0-2a4cf5085d0a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:11.847198 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-586f0b8d-e267-4196-b0b0-2a4cf5085d0a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:11.847988 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-586f0b8d-e267-4196-b0b0-2a4cf5085d0a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:11.848424 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-586f0b8d-e267-4196-b0b0-2a4cf5085d0a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:11.966454 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-586f0b8d-e267-4196-b0b0-2a4cf5085d0a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:11.975991 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-586f0b8d-e267-4196-b0b0-2a4cf5085d0a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:11.977794 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-586f0b8d-e267-4196-b0b0-2a4cf5085d0a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:11.978929 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-586f0b8d-e267-4196-b0b0-2a4cf5085d0a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.144650 Apr 30 13:29:11.979480 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 747/1391] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:29:11 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:29:12.265617 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-1fd92e03-5ee0-41d1-b144-560c3b12e01f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:12.266329 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-1fd92e03-5ee0-41d1-b144-560c3b12e01f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:12.274595 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1fd92e03-5ee0-41d1-b144-560c3b12e01f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:12.275049 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1fd92e03-5ee0-41d1-b144-560c3b12e01f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:12.275837 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1fd92e03-5ee0-41d1-b144-560c3b12e01f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:12.276277 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1fd92e03-5ee0-41d1-b144-560c3b12e01f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:12.477479 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-1fd92e03-5ee0-41d1-b144-560c3b12e01f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:12.485930 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-1fd92e03-5ee0-41d1-b144-560c3b12e01f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.224073 Apr 30 13:29:12.487337 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 645/1392] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:12 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:29:12.997103 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-22523e14-ccdc-4019-a0cb-db17c6ed72cb tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:12.997725 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-22523e14-ccdc-4019-a0cb-db17c6ed72cb tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:13.005209 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-22523e14-ccdc-4019-a0cb-db17c6ed72cb tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:13.005663 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-22523e14-ccdc-4019-a0cb-db17c6ed72cb tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:13.006496 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-22523e14-ccdc-4019-a0cb-db17c6ed72cb tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:13.006938 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-22523e14-ccdc-4019-a0cb-db17c6ed72cb tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:13.122796 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-22523e14-ccdc-4019-a0cb-db17c6ed72cb tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:13.132210 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-22523e14-ccdc-4019-a0cb-db17c6ed72cb tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:13.133716 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-22523e14-ccdc-4019-a0cb-db17c6ed72cb tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:13.134875 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-22523e14-ccdc-4019-a0cb-db17c6ed72cb tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.141687 Apr 30 13:29:13.135437 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 748/1393] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:29:12 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:29:13.503735 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-02d4419f-a994-465a-831f-3cefdfa2cbe0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:13.504348 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-02d4419f-a994-465a-831f-3cefdfa2cbe0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:13.511899 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-02d4419f-a994-465a-831f-3cefdfa2cbe0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:13.512348 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-02d4419f-a994-465a-831f-3cefdfa2cbe0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:13.513134 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-02d4419f-a994-465a-831f-3cefdfa2cbe0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:13.513573 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-02d4419f-a994-465a-831f-3cefdfa2cbe0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:13.712825 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-02d4419f-a994-465a-831f-3cefdfa2cbe0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:13.722067 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-02d4419f-a994-465a-831f-3cefdfa2cbe0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.222063 Apr 30 13:29:13.722647 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 646/1394] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:13 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:29:14.153402 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-45b064df-c33e-440b-ad27-3f1c63b4dfda tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:14.154041 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-45b064df-c33e-440b-ad27-3f1c63b4dfda tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:14.162616 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-45b064df-c33e-440b-ad27-3f1c63b4dfda tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:14.163073 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-45b064df-c33e-440b-ad27-3f1c63b4dfda tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:14.163864 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-45b064df-c33e-440b-ad27-3f1c63b4dfda tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:14.164300 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-45b064df-c33e-440b-ad27-3f1c63b4dfda tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:14.344695 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-45b064df-c33e-440b-ad27-3f1c63b4dfda tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:14.354426 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-45b064df-c33e-440b-ad27-3f1c63b4dfda tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:14.355985 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-45b064df-c33e-440b-ad27-3f1c63b4dfda tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:14.357110 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-45b064df-c33e-440b-ad27-3f1c63b4dfda tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.208082 Apr 30 13:29:14.357667 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 749/1395] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:29:14 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:29:14.739426 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-a76e57ba-7145-43e9-8497-b71a1d81cf89 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:14.740176 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-a76e57ba-7145-43e9-8497-b71a1d81cf89 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:14.747524 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a76e57ba-7145-43e9-8497-b71a1d81cf89 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:14.747973 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a76e57ba-7145-43e9-8497-b71a1d81cf89 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:14.748758 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a76e57ba-7145-43e9-8497-b71a1d81cf89 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:14.749195 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a76e57ba-7145-43e9-8497-b71a1d81cf89 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:14.950512 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-a76e57ba-7145-43e9-8497-b71a1d81cf89 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:14.959201 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-a76e57ba-7145-43e9-8497-b71a1d81cf89 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.224354 Apr 30 13:29:14.959765 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 647/1396] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:14 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:29:15.375632 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-17e7ca59-286e-4dfd-b5ec-c2deab2e2b5c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:15.376250 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-17e7ca59-286e-4dfd-b5ec-c2deab2e2b5c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:15.383723 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-17e7ca59-286e-4dfd-b5ec-c2deab2e2b5c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:15.384184 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-17e7ca59-286e-4dfd-b5ec-c2deab2e2b5c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:15.384970 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-17e7ca59-286e-4dfd-b5ec-c2deab2e2b5c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:15.385415 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-17e7ca59-286e-4dfd-b5ec-c2deab2e2b5c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:15.502078 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-17e7ca59-286e-4dfd-b5ec-c2deab2e2b5c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:15.512839 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-17e7ca59-286e-4dfd-b5ec-c2deab2e2b5c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:15.514367 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-17e7ca59-286e-4dfd-b5ec-c2deab2e2b5c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:15.515479 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-17e7ca59-286e-4dfd-b5ec-c2deab2e2b5c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.143713 Apr 30 13:29:15.516036 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 750/1397] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:29:15 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:29:15.976346 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-88e6704e-56a2-45ae-b849-5ba12feb49e9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:15.976959 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-88e6704e-56a2-45ae-b849-5ba12feb49e9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:15.984272 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-88e6704e-56a2-45ae-b849-5ba12feb49e9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:15.984749 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-88e6704e-56a2-45ae-b849-5ba12feb49e9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:15.985522 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-88e6704e-56a2-45ae-b849-5ba12feb49e9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:15.985955 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-88e6704e-56a2-45ae-b849-5ba12feb49e9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:16.186661 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-88e6704e-56a2-45ae-b849-5ba12feb49e9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:16.196191 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-88e6704e-56a2-45ae-b849-5ba12feb49e9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.223557 Apr 30 13:29:16.196758 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 648/1398] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:15 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:29:16.534439 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-afeb6e8d-6488-481f-b8f1-228e72837323 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:16.535490 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-afeb6e8d-6488-481f-b8f1-228e72837323 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:16.542740 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-afeb6e8d-6488-481f-b8f1-228e72837323 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:16.543198 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-afeb6e8d-6488-481f-b8f1-228e72837323 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:16.543995 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-afeb6e8d-6488-481f-b8f1-228e72837323 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:16.544441 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-afeb6e8d-6488-481f-b8f1-228e72837323 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:16.669746 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-afeb6e8d-6488-481f-b8f1-228e72837323 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:16.679970 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-afeb6e8d-6488-481f-b8f1-228e72837323 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:16.681492 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-afeb6e8d-6488-481f-b8f1-228e72837323 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:16.682725 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-afeb6e8d-6488-481f-b8f1-228e72837323 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.152878 Apr 30 13:29:16.683293 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 751/1399] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:29:16 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:29:17.213404 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-57debbfe-51be-4f57-8231-bd2731482952 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:17.214065 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-57debbfe-51be-4f57-8231-bd2731482952 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:17.221745 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-57debbfe-51be-4f57-8231-bd2731482952 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:17.222245 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-57debbfe-51be-4f57-8231-bd2731482952 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:17.223029 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-57debbfe-51be-4f57-8231-bd2731482952 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:17.223469 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-57debbfe-51be-4f57-8231-bd2731482952 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:17.428860 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-57debbfe-51be-4f57-8231-bd2731482952 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:17.437690 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-57debbfe-51be-4f57-8231-bd2731482952 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.227943 Apr 30 13:29:17.438496 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 649/1400] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:17 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:29:17.699791 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b3fc5f4c-434f-4a03-96ad-04c5f9b431bd tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:17.700414 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-b3fc5f4c-434f-4a03-96ad-04c5f9b431bd tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:17.707887 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b3fc5f4c-434f-4a03-96ad-04c5f9b431bd tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:17.708346 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b3fc5f4c-434f-4a03-96ad-04c5f9b431bd tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:17.709140 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b3fc5f4c-434f-4a03-96ad-04c5f9b431bd tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:17.709586 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b3fc5f4c-434f-4a03-96ad-04c5f9b431bd tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:17.828965 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-b3fc5f4c-434f-4a03-96ad-04c5f9b431bd tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:17.838858 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-b3fc5f4c-434f-4a03-96ad-04c5f9b431bd tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:17.840381 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-b3fc5f4c-434f-4a03-96ad-04c5f9b431bd tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:17.841507 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b3fc5f4c-434f-4a03-96ad-04c5f9b431bd tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.145506 Apr 30 13:29:17.842088 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 752/1401] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:29:17 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:29:18.455148 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-fafa54e8-2bb6-4926-bd5f-9bb269869d01 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:18.455782 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-fafa54e8-2bb6-4926-bd5f-9bb269869d01 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:18.463067 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fafa54e8-2bb6-4926-bd5f-9bb269869d01 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:18.463501 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fafa54e8-2bb6-4926-bd5f-9bb269869d01 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:18.464984 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fafa54e8-2bb6-4926-bd5f-9bb269869d01 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:18.465425 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fafa54e8-2bb6-4926-bd5f-9bb269869d01 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:18.667068 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-fafa54e8-2bb6-4926-bd5f-9bb269869d01 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:18.676251 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-fafa54e8-2bb6-4926-bd5f-9bb269869d01 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.224817 Apr 30 13:29:18.676868 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 650/1402] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:18 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:29:18.859618 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b721519b-8514-4cf5-befb-32ae9cfe324f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:18.860135 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-b721519b-8514-4cf5-befb-32ae9cfe324f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:18.868455 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b721519b-8514-4cf5-befb-32ae9cfe324f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:18.868911 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b721519b-8514-4cf5-befb-32ae9cfe324f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:18.869733 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b721519b-8514-4cf5-befb-32ae9cfe324f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:18.870248 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b721519b-8514-4cf5-befb-32ae9cfe324f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:18.983437 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-b721519b-8514-4cf5-befb-32ae9cfe324f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:18.993599 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-b721519b-8514-4cf5-befb-32ae9cfe324f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:18.995167 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-b721519b-8514-4cf5-befb-32ae9cfe324f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:18.996282 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b721519b-8514-4cf5-befb-32ae9cfe324f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.140576 Apr 30 13:29:18.996842 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 753/1403] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:29:18 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:29:19.693994 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-84e51c5e-e89f-42f3-8f9f-603d2c907864 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:19.694640 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-84e51c5e-e89f-42f3-8f9f-603d2c907864 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:19.702078 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-84e51c5e-e89f-42f3-8f9f-603d2c907864 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:19.702549 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-84e51c5e-e89f-42f3-8f9f-603d2c907864 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:19.703333 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-84e51c5e-e89f-42f3-8f9f-603d2c907864 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:19.703774 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-84e51c5e-e89f-42f3-8f9f-603d2c907864 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:19.902751 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-84e51c5e-e89f-42f3-8f9f-603d2c907864 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:19.912224 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-84e51c5e-e89f-42f3-8f9f-603d2c907864 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.221938 Apr 30 13:29:19.912775 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 651/1404] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:19 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:29:20.014288 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-09cab894-fdf9-42c7-8312-fd7c4910599e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:20.014820 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-09cab894-fdf9-42c7-8312-fd7c4910599e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:20.022335 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-09cab894-fdf9-42c7-8312-fd7c4910599e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:20.022789 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-09cab894-fdf9-42c7-8312-fd7c4910599e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:20.023569 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-09cab894-fdf9-42c7-8312-fd7c4910599e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:20.024011 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-09cab894-fdf9-42c7-8312-fd7c4910599e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:20.144861 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-09cab894-fdf9-42c7-8312-fd7c4910599e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:20.154514 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-09cab894-fdf9-42c7-8312-fd7c4910599e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:20.156000 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-09cab894-fdf9-42c7-8312-fd7c4910599e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:20.157322 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-09cab894-fdf9-42c7-8312-fd7c4910599e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.146930 Apr 30 13:29:20.157967 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 754/1405] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:29:20 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:29:20.707714 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-348b34b7-5c27-4121-a853-82eb3e3e82b6 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:20.708240 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-348b34b7-5c27-4121-a853-82eb3e3e82b6 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 51ec80af-a515-409f-a251-9d0a9718889b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:20.715527 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-348b34b7-5c27-4121-a853-82eb3e3e82b6 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:20.715983 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-348b34b7-5c27-4121-a853-82eb3e3e82b6 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:20.716764 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-348b34b7-5c27-4121-a853-82eb3e3e82b6 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:20.717207 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-348b34b7-5c27-4121-a853-82eb3e3e82b6 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:20.779651 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-348b34b7-5c27-4121-a853-82eb3e3e82b6 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 51ec80af-a515-409f-a251-9d0a9718889b] Going to try to terminate instance {{(pid=87932) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 13:29:20.902733 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-348b34b7-5c27-4121-a853-82eb3e3e82b6 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "DELETE /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b" status: 204 len: 0 microversion: 2.1 time: 0.198352 Apr 30 13:29:20.903082 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 652/1406] 10.222.0.79 () {58 vars in 1239 bytes} [Fri Apr 30 13:29:20 2021] DELETE /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 13:29:20.912456 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-9016095d-b2ab-4741-8b0e-7a51318dbedb tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:20.913072 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-9016095d-b2ab-4741-8b0e-7a51318dbedb tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 51ec80af-a515-409f-a251-9d0a9718889b] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:20.920870 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9016095d-b2ab-4741-8b0e-7a51318dbedb tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:20.921321 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9016095d-b2ab-4741-8b0e-7a51318dbedb tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:20.922136 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9016095d-b2ab-4741-8b0e-7a51318dbedb tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:20.922578 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9016095d-b2ab-4741-8b0e-7a51318dbedb tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:20.929184 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-0d8496c9-1b73-40be-9d71-c825d4826087 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:20.929899 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-0d8496c9-1b73-40be-9d71-c825d4826087 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:20.937365 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0d8496c9-1b73-40be-9d71-c825d4826087 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:20.940669 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0d8496c9-1b73-40be-9d71-c825d4826087 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:20.940669 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0d8496c9-1b73-40be-9d71-c825d4826087 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:20.940669 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0d8496c9-1b73-40be-9d71-c825d4826087 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:21.129875 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-9016095d-b2ab-4741-8b0e-7a51318dbedb tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f2e072f58341ac85f9f856603b0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795985fdb0c545438436572c0f48ee24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:21.138351 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-9016095d-b2ab-4741-8b0e-7a51318dbedb tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "GET /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b" status: 200 len: 1674 microversion: 2.1 time: 0.230789 Apr 30 13:29:21.138984 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 755/1407] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:20 2021] GET /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b => generated 1674 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:29:21.145277 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-0d8496c9-1b73-40be-9d71-c825d4826087 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:21.153708 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-0d8496c9-1b73-40be-9d71-c825d4826087 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.228726 Apr 30 13:29:21.154314 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 653/1408] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:20 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:29:21.175562 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-d7054078-4c25-4b94-9a7a-293d3487fa41 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:21.176171 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-d7054078-4c25-4b94-9a7a-293d3487fa41 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:21.183580 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d7054078-4c25-4b94-9a7a-293d3487fa41 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:21.184205 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d7054078-4c25-4b94-9a7a-293d3487fa41 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:21.185578 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d7054078-4c25-4b94-9a7a-293d3487fa41 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:21.185578 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d7054078-4c25-4b94-9a7a-293d3487fa41 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:21.299855 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-d7054078-4c25-4b94-9a7a-293d3487fa41 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:21.310037 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-d7054078-4c25-4b94-9a7a-293d3487fa41 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:21.311551 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-d7054078-4c25-4b94-9a7a-293d3487fa41 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:21.312666 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-d7054078-4c25-4b94-9a7a-293d3487fa41 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.141031 Apr 30 13:29:21.313227 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 756/1409] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:29:21 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:29:22.156526 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-e996fdbe-b281-4a2c-84c3-abdd67a58cb7 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:22.157093 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-e996fdbe-b281-4a2c-84c3-abdd67a58cb7 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 51ec80af-a515-409f-a251-9d0a9718889b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:22.165379 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e996fdbe-b281-4a2c-84c3-abdd67a58cb7 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:22.165836 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e996fdbe-b281-4a2c-84c3-abdd67a58cb7 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:22.166664 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e996fdbe-b281-4a2c-84c3-abdd67a58cb7 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:22.167106 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e996fdbe-b281-4a2c-84c3-abdd67a58cb7 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:22.171842 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-20f5a8ef-28be-4f11-9833-277e94b7823f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:22.172598 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-20f5a8ef-28be-4f11-9833-277e94b7823f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:22.181014 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-20f5a8ef-28be-4f11-9833-277e94b7823f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:22.181579 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-20f5a8ef-28be-4f11-9833-277e94b7823f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:22.182488 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-20f5a8ef-28be-4f11-9833-277e94b7823f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:22.183025 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-20f5a8ef-28be-4f11-9833-277e94b7823f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:22.388321 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-20f5a8ef-28be-4f11-9833-277e94b7823f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:22.397352 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-20f5a8ef-28be-4f11-9833-277e94b7823f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.229252 Apr 30 13:29:22.398275 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 757/1410] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:22 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:29:22.402493 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-2fe04b97-6ed0-4945-bca7-692f29768130 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:22.403107 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-2fe04b97-6ed0-4945-bca7-692f29768130 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:22.411097 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2fe04b97-6ed0-4945-bca7-692f29768130 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:22.411476 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2fe04b97-6ed0-4945-bca7-692f29768130 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:22.412275 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2fe04b97-6ed0-4945-bca7-692f29768130 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:22.412713 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2fe04b97-6ed0-4945-bca7-692f29768130 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:22.516539 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-e996fdbe-b281-4a2c-84c3-abdd67a58cb7 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f2e072f58341ac85f9f856603b0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795985fdb0c545438436572c0f48ee24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:22.526397 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-e996fdbe-b281-4a2c-84c3-abdd67a58cb7 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "GET /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b" status: 200 len: 1674 microversion: 2.1 time: 0.373442 Apr 30 13:29:22.536988 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 654/1411] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:22 2021] GET /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b => generated 1674 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:29:22.674409 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-2fe04b97-6ed0-4945-bca7-692f29768130 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:22.684735 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-2fe04b97-6ed0-4945-bca7-692f29768130 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:22.686288 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-2fe04b97-6ed0-4945-bca7-692f29768130 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:22.687432 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-2fe04b97-6ed0-4945-bca7-692f29768130 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.288544 Apr 30 13:29:22.688091 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 758/1412] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:29:22 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:29:23.172404 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [req-f2eb43a8-1308-425d-be3f-0375ad3c8e60 req-5e2318ad-872d-4856-a984-5fda45fb5f0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51ec80af-a515-409f-a251-9d0a9718889b", "name": "network-vif-deleted", "tag": "a66cfb5b-8d13-4a42-a6be-066e52aaf9b2"}]} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:29:23.175720 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:29:23.175720 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: warnings.warn(msg) Apr 30 13:29:23.191109 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-f2eb43a8-1308-425d-be3f-0375ad3c8e60 req-5e2318ad-872d-4856-a984-5fda45fb5f0c service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:23.191620 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-f2eb43a8-1308-425d-be3f-0375ad3c8e60 req-5e2318ad-872d-4856-a984-5fda45fb5f0c service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:23.209644 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.compute.server_external_events [req-f2eb43a8-1308-425d-be3f-0375ad3c8e60 req-5e2318ad-872d-4856-a984-5fda45fb5f0c service nova] Creating event network-vif-deleted:a66cfb5b-8d13-4a42-a6be-066e52aaf9b2 for instance 51ec80af-a515-409f-a251-9d0a9718889b on hv-cinder-78836 Apr 30 13:29:23.215155 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [req-f2eb43a8-1308-425d-be3f-0375ad3c8e60 req-5e2318ad-872d-4856-a984-5fda45fb5f0c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046338 Apr 30 13:29:23.215796 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 655/1413] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:29:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:29:23.414704 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-5f406a3d-f266-43f0-b7b7-8e86ca19757d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:23.415337 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-5f406a3d-f266-43f0-b7b7-8e86ca19757d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:23.423093 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5f406a3d-f266-43f0-b7b7-8e86ca19757d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:23.423750 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5f406a3d-f266-43f0-b7b7-8e86ca19757d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:23.424622 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5f406a3d-f266-43f0-b7b7-8e86ca19757d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:23.425067 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5f406a3d-f266-43f0-b7b7-8e86ca19757d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:23.545818 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-49b77681-2680-4f9c-8498-7e7b2114601f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:23.546873 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-49b77681-2680-4f9c-8498-7e7b2114601f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 51ec80af-a515-409f-a251-9d0a9718889b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:23.555008 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-49b77681-2680-4f9c-8498-7e7b2114601f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:23.555803 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-49b77681-2680-4f9c-8498-7e7b2114601f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:23.556747 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-49b77681-2680-4f9c-8498-7e7b2114601f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:23.557324 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-49b77681-2680-4f9c-8498-7e7b2114601f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:23.659976 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-5f406a3d-f266-43f0-b7b7-8e86ca19757d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:23.669529 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-5f406a3d-f266-43f0-b7b7-8e86ca19757d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.258806 Apr 30 13:29:23.678638 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-49b77681-2680-4f9c-8498-7e7b2114601f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:23.679869 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-49b77681-2680-4f9c-8498-7e7b2114601f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:23.680815 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.objects.instance [None req-49b77681-2680-4f9c-8498-7e7b2114601f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lazy-loading 'fault' on Instance uuid 51ec80af-a515-409f-a251-9d0a9718889b {{(pid=87932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:29:23.681028 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 759/1414] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:23 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:29:23.708242 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-a4a99402-78d1-4bcb-a834-e88ef18445da tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:23.709509 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-a4a99402-78d1-4bcb-a834-e88ef18445da tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:23.717547 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a4a99402-78d1-4bcb-a834-e88ef18445da tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:23.718030 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a4a99402-78d1-4bcb-a834-e88ef18445da tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:23.718940 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a4a99402-78d1-4bcb-a834-e88ef18445da tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:23.719383 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a4a99402-78d1-4bcb-a834-e88ef18445da tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:23.815332 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-49b77681-2680-4f9c-8498-7e7b2114601f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f2e072f58341ac85f9f856603b0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795985fdb0c545438436572c0f48ee24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:23.836827 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-49b77681-2680-4f9c-8498-7e7b2114601f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "GET /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b" status: 200 len: 1328 microversion: 2.1 time: 0.295205 Apr 30 13:29:23.850988 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 656/1415] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:23 2021] GET /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b => generated 1328 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:29:23.856949 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-a4a99402-78d1-4bcb-a834-e88ef18445da tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:23.867744 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-a4a99402-78d1-4bcb-a834-e88ef18445da tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:23.869328 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-a4a99402-78d1-4bcb-a834-e88ef18445da tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:23.870567 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-a4a99402-78d1-4bcb-a834-e88ef18445da tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.167196 Apr 30 13:29:23.871481 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 760/1416] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:29:23 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:29:24.688218 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-4ceb1d75-402d-48ae-847f-3c4cb7dbd4d5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:24.689017 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-4ceb1d75-402d-48ae-847f-3c4cb7dbd4d5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:24.697619 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4ceb1d75-402d-48ae-847f-3c4cb7dbd4d5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:24.698111 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4ceb1d75-402d-48ae-847f-3c4cb7dbd4d5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:24.699002 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4ceb1d75-402d-48ae-847f-3c4cb7dbd4d5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:24.699472 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4ceb1d75-402d-48ae-847f-3c4cb7dbd4d5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:24.857512 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-aede766c-a7da-4ea9-bdc9-345a8464a09c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:24.858154 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-aede766c-a7da-4ea9-bdc9-345a8464a09c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 51ec80af-a515-409f-a251-9d0a9718889b] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:24.867063 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-aede766c-a7da-4ea9-bdc9-345a8464a09c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:24.867521 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-aede766c-a7da-4ea9-bdc9-345a8464a09c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:24.868314 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-aede766c-a7da-4ea9-bdc9-345a8464a09c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:24.868748 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-aede766c-a7da-4ea9-bdc9-345a8464a09c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:24.904026 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-4ceb1d75-402d-48ae-847f-3c4cb7dbd4d5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:24.914863 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-4ceb1d75-402d-48ae-847f-3c4cb7dbd4d5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.230465 Apr 30 13:29:24.915444 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 657/1417] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:24 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:29:24.919890 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-f4324d5c-f4dc-4bf4-ac29-5ae19d0d4a35 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:24.920416 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-f4324d5c-f4dc-4bf4-ac29-5ae19d0d4a35 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:24.921385 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.wsgi [None req-aede766c-a7da-4ea9-bdc9-345a8464a09c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] HTTP exception thrown: Instance 51ec80af-a515-409f-a251-9d0a9718889b could not be found. Apr 30 13:29:24.922023 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-aede766c-a7da-4ea9-bdc9-345a8464a09c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Returning 404 to user: Instance 51ec80af-a515-409f-a251-9d0a9718889b could not be found. {{(pid=87933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:29:24.922904 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-aede766c-a7da-4ea9-bdc9-345a8464a09c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "GET /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b" status: 404 len: 111 microversion: 2.1 time: 0.069169 Apr 30 13:29:24.924003 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 761/1418] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:24 2021] GET /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 13:29:24.928807 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f4324d5c-f4dc-4bf4-ac29-5ae19d0d4a35 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:24.929341 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f4324d5c-f4dc-4bf4-ac29-5ae19d0d4a35 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:24.931437 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f4324d5c-f4dc-4bf4-ac29-5ae19d0d4a35 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:24.931437 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f4324d5c-f4dc-4bf4-ac29-5ae19d0d4a35 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:24.932295 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b0dec804-fa66-4d4e-80ba-28a026ebdb41 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Calling method '.version_select at 0x7f7500080670>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:24.953928 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b0dec804-fa66-4d4e-80ba-28a026ebdb41 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2018148527" status: 202 len: 0 microversion: 2.1 time: 0.025340 Apr 30 13:29:24.954830 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 762/1419] 10.222.0.79 () {58 vars in 1221 bytes} [Fri Apr 30 13:29:24 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2018148527 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 13:29:25.079352 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-f4324d5c-f4dc-4bf4-ac29-5ae19d0d4a35 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:25.093352 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-f4324d5c-f4dc-4bf4-ac29-5ae19d0d4a35 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:25.097500 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-f4324d5c-f4dc-4bf4-ac29-5ae19d0d4a35 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:25.099202 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-f4324d5c-f4dc-4bf4-ac29-5ae19d0d4a35 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.182763 Apr 30 13:29:25.100184 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 658/1420] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:29:24 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:29:25.936154 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-8359cb4b-b14f-4a63-a651-6a3c41d990a8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:25.936782 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-8359cb4b-b14f-4a63-a651-6a3c41d990a8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:25.945674 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8359cb4b-b14f-4a63-a651-6a3c41d990a8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:25.946169 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8359cb4b-b14f-4a63-a651-6a3c41d990a8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:25.946973 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8359cb4b-b14f-4a63-a651-6a3c41d990a8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:25.947420 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8359cb4b-b14f-4a63-a651-6a3c41d990a8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:26.118502 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-fcb17ef1-57d2-45a2-9983-18315ad00d10 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:26.119038 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-fcb17ef1-57d2-45a2-9983-18315ad00d10 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:26.126741 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fcb17ef1-57d2-45a2-9983-18315ad00d10 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:26.127182 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fcb17ef1-57d2-45a2-9983-18315ad00d10 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:26.127994 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fcb17ef1-57d2-45a2-9983-18315ad00d10 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:26.128436 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fcb17ef1-57d2-45a2-9983-18315ad00d10 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:26.246135 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-8359cb4b-b14f-4a63-a651-6a3c41d990a8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:26.255926 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-8359cb4b-b14f-4a63-a651-6a3c41d990a8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.323595 Apr 30 13:29:26.256695 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 763/1421] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:25 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:29:26.260907 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-03e09537-cfad-4134-a376-70b0a8b20578 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'create', calling method: .version_select at 0x7f74fb7a48b0>, body: {"keypair": {"name": "tempest-keypair-1906955888"}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:29:26.273029 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-fcb17ef1-57d2-45a2-9983-18315ad00d10 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:26.282384 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-fcb17ef1-57d2-45a2-9983-18315ad00d10 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:26.283239 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.quota [None req-03e09537-cfad-4134-a376-70b0a8b20578 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Getting quotas for project 795985fdb0c545438436572c0f48ee24. Resources: {'key_pairs'} {{(pid=87933) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:29:26.284505 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-fcb17ef1-57d2-45a2-9983-18315ad00d10 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:26.285914 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-fcb17ef1-57d2-45a2-9983-18315ad00d10 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.171377 Apr 30 13:29:26.286530 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 659/1422] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:29:26 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:29:26.287874 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.quota [None req-03e09537-cfad-4134-a376-70b0a8b20578 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Getting quotas for user a0f2e072f58341ac85f9f856603b0dc9 and project 795985fdb0c545438436572c0f48ee24. Resources: {'key_pairs'} {{(pid=87933) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:29:26.618554 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.quota [None req-03e09537-cfad-4134-a376-70b0a8b20578 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Getting quotas for project 795985fdb0c545438436572c0f48ee24. Resources: {'key_pairs'} {{(pid=87933) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:29:26.622301 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.quota [None req-03e09537-cfad-4134-a376-70b0a8b20578 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Getting quotas for user a0f2e072f58341ac85f9f856603b0dc9 and project 795985fdb0c545438436572c0f48ee24. Resources: {'key_pairs'} {{(pid=87933) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:29:26.634944 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-03e09537-cfad-4134-a376-70b0a8b20578 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.377462 Apr 30 13:29:26.635545 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 764/1423] 10.222.0.79 () {60 vars in 1158 bytes} [Fri Apr 30 13:29:26 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:29:27.273546 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-6df93476-f2b3-491c-a617-f123cd851b9d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:27.274407 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-6df93476-f2b3-491c-a617-f123cd851b9d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:27.282514 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6df93476-f2b3-491c-a617-f123cd851b9d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:27.283301 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6df93476-f2b3-491c-a617-f123cd851b9d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:27.284290 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6df93476-f2b3-491c-a617-f123cd851b9d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:27.285028 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6df93476-f2b3-491c-a617-f123cd851b9d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:27.303790 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-3f38e18a-3281-4455-8c79-bf9987e6a97f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:27.305147 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-3f38e18a-3281-4455-8c79-bf9987e6a97f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:27.313674 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3f38e18a-3281-4455-8c79-bf9987e6a97f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:27.315192 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3f38e18a-3281-4455-8c79-bf9987e6a97f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:27.316223 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3f38e18a-3281-4455-8c79-bf9987e6a97f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:27.316827 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3f38e18a-3281-4455-8c79-bf9987e6a97f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:27.444851 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-3f38e18a-3281-4455-8c79-bf9987e6a97f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:27.455725 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-3f38e18a-3281-4455-8c79-bf9987e6a97f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:27.457269 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-3f38e18a-3281-4455-8c79-bf9987e6a97f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:27.458457 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-3f38e18a-3281-4455-8c79-bf9987e6a97f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.158493 Apr 30 13:29:27.459336 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 765/1424] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:29:27 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:29:27.499764 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-6df93476-f2b3-491c-a617-f123cd851b9d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:27.508990 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-6df93476-f2b3-491c-a617-f123cd851b9d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.239112 Apr 30 13:29:27.509587 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 660/1425] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:27 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:29:28.456782 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-1d496c13-851d-4ade-8f3d-8aaa3dc84839 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1470452841", "imageRef": "705a0c6b-b003-4687-84bf-8b9f87dae39e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0cc87707-d905-4c01-8755-7767acf4ce00"}], "security_groups": [{"name": "tempest-securitygroup--2032842716"}], "key_name": "tempest-keypair-1906955888", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:29:28.476578 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-8eb6d4db-7d70-45d1-bb84-5c9a75bf550a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:28.477193 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-8eb6d4db-7d70-45d1-bb84-5c9a75bf550a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:28.485230 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8eb6d4db-7d70-45d1-bb84-5c9a75bf550a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:28.486047 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8eb6d4db-7d70-45d1-bb84-5c9a75bf550a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:28.486865 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8eb6d4db-7d70-45d1-bb84-5c9a75bf550a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:28.487301 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8eb6d4db-7d70-45d1-bb84-5c9a75bf550a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:28.607232 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.network.neutron [None req-1d496c13-851d-4ade-8f3d-8aaa3dc84839 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] validate_networks() for [('0cc87707-d905-4c01-8755-7767acf4ce00', None, None, None)] {{(pid=87933) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 13:29:28.607566 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-8eb6d4db-7d70-45d1-bb84-5c9a75bf550a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:28.617469 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-8eb6d4db-7d70-45d1-bb84-5c9a75bf550a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:28.619016 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-8eb6d4db-7d70-45d1-bb84-5c9a75bf550a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:28.620136 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-8eb6d4db-7d70-45d1-bb84-5c9a75bf550a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.147328 Apr 30 13:29:28.620695 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 661/1426] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:29:28 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:29:28.625082 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-6366ce9f-63d9-43ec-9aca-810ed29f87f4 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:28.625689 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-6366ce9f-63d9-43ec-9aca-810ed29f87f4 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:28.634452 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6366ce9f-63d9-43ec-9aca-810ed29f87f4 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:28.634848 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6366ce9f-63d9-43ec-9aca-810ed29f87f4 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:28.635639 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6366ce9f-63d9-43ec-9aca-810ed29f87f4 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:28.636073 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6366ce9f-63d9-43ec-9aca-810ed29f87f4 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:28.847031 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-6366ce9f-63d9-43ec-9aca-810ed29f87f4 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:28.859376 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-6366ce9f-63d9-43ec-9aca-810ed29f87f4 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.237649 Apr 30 13:29:28.860104 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 662/1427] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:28 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:29:29.375377 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.virt.hardware [None req-1d496c13-851d-4ade-8f3d-8aaa3dc84839 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Flavor limits 0:0:0 {{(pid=87933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 13:29:29.375808 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.virt.hardware [None req-1d496c13-851d-4ade-8f3d-8aaa3dc84839 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Image limits 0:0:0 {{(pid=87933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 13:29:29.376368 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.virt.hardware [None req-1d496c13-851d-4ade-8f3d-8aaa3dc84839 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Flavor pref 0:0:0 {{(pid=87933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 13:29:29.376820 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.virt.hardware [None req-1d496c13-851d-4ade-8f3d-8aaa3dc84839 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Image pref 0:0:0 {{(pid=87933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 13:29:29.377329 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.virt.hardware [None req-1d496c13-851d-4ade-8f3d-8aaa3dc84839 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 13:29:29.385845 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1d496c13-851d-4ade-8f3d-8aaa3dc84839 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:29.386353 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1d496c13-851d-4ade-8f3d-8aaa3dc84839 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:29.387168 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1d496c13-851d-4ade-8f3d-8aaa3dc84839 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:29.388781 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1d496c13-851d-4ade-8f3d-8aaa3dc84839 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:29.406307 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.quota [None req-1d496c13-851d-4ade-8f3d-8aaa3dc84839 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Getting quotas for project 795985fdb0c545438436572c0f48ee24. Resources: {'ram', 'instances', 'cores'} {{(pid=87933) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:29:29.411236 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.quota [None req-1d496c13-851d-4ade-8f3d-8aaa3dc84839 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Getting quotas for user a0f2e072f58341ac85f9f856603b0dc9 and project 795985fdb0c545438436572c0f48ee24. Resources: {'ram', 'instances', 'cores'} {{(pid=87933) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:29:29.422396 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-1d496c13-851d-4ade-8f3d-8aaa3dc84839 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Going to run 1 instances... {{(pid=87933) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 13:29:29.425578 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-1d496c13-851d-4ade-8f3d-8aaa3dc84839 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='705a0c6b-b003-4687-84bf-8b9f87dae39e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=87933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 13:29:29.473003 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-1d496c13-851d-4ade-8f3d-8aaa3dc84839 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.021445 Apr 30 13:29:29.473954 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 766/1428] 10.222.0.79 () {60 vars in 1147 bytes} [Fri Apr 30 13:29:28 2021] POST /compute/v2.1/servers => generated 402 bytes in 1023 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 13:29:29.483613 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-70afb1d6-2477-4229-a6be-85d82c40b091 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:29.484811 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-70afb1d6-2477-4229-a6be-85d82c40b091 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:29.637870 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-4a9440bb-500a-443a-9efc-5cc6a2c34ee8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:29.638589 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-4a9440bb-500a-443a-9efc-5cc6a2c34ee8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:29.647157 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4a9440bb-500a-443a-9efc-5cc6a2c34ee8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:29.648703 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4a9440bb-500a-443a-9efc-5cc6a2c34ee8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:29.648703 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4a9440bb-500a-443a-9efc-5cc6a2c34ee8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:29.649054 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4a9440bb-500a-443a-9efc-5cc6a2c34ee8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:29.658970 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-70afb1d6-2477-4229-a6be-85d82c40b091 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f2e072f58341ac85f9f856603b0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795985fdb0c545438436572c0f48ee24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:29.667436 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-70afb1d6-2477-4229-a6be-85d82c40b091 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "GET /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021" status: 200 len: 1238 microversion: 2.1 time: 0.187740 Apr 30 13:29:29.668039 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 663/1429] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:29 2021] GET /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021 => generated 1238 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:29:29.767535 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-4a9440bb-500a-443a-9efc-5cc6a2c34ee8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:29.776893 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-4a9440bb-500a-443a-9efc-5cc6a2c34ee8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:29.778441 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-4a9440bb-500a-443a-9efc-5cc6a2c34ee8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:29.779556 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-4a9440bb-500a-443a-9efc-5cc6a2c34ee8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.145473 Apr 30 13:29:29.780118 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 767/1430] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:29:29 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:29:29.877282 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-1dcd233d-7bc1-4d4f-aa75-de3777162564 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:29.877927 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-1dcd233d-7bc1-4d4f-aa75-de3777162564 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:29.885710 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1dcd233d-7bc1-4d4f-aa75-de3777162564 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:29.886336 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1dcd233d-7bc1-4d4f-aa75-de3777162564 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:29.887126 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1dcd233d-7bc1-4d4f-aa75-de3777162564 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:29.887568 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1dcd233d-7bc1-4d4f-aa75-de3777162564 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:30.098268 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-1dcd233d-7bc1-4d4f-aa75-de3777162564 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:30.107954 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-1dcd233d-7bc1-4d4f-aa75-de3777162564 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.235149 Apr 30 13:29:30.108527 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 664/1431] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:29 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:29:30.684725 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-fbd7d778-99d0-40a0-9438-7e236e2a41ef tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:30.685472 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-fbd7d778-99d0-40a0-9438-7e236e2a41ef tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:30.693528 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-fbd7d778-99d0-40a0-9438-7e236e2a41ef tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:30.694070 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-fbd7d778-99d0-40a0-9438-7e236e2a41ef tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:30.695039 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-fbd7d778-99d0-40a0-9438-7e236e2a41ef tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:30.695513 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-fbd7d778-99d0-40a0-9438-7e236e2a41ef tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:30.799506 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-1a3eb96d-91c7-470a-a0a3-ecd5f3cdeb22 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:30.800860 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-1a3eb96d-91c7-470a-a0a3-ecd5f3cdeb22 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:30.809555 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1a3eb96d-91c7-470a-a0a3-ecd5f3cdeb22 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:30.810298 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1a3eb96d-91c7-470a-a0a3-ecd5f3cdeb22 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:30.811363 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1a3eb96d-91c7-470a-a0a3-ecd5f3cdeb22 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:30.811985 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1a3eb96d-91c7-470a-a0a3-ecd5f3cdeb22 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:30.853714 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-fbd7d778-99d0-40a0-9438-7e236e2a41ef tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f2e072f58341ac85f9f856603b0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795985fdb0c545438436572c0f48ee24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:30.870526 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-fbd7d778-99d0-40a0-9438-7e236e2a41ef tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "GET /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021" status: 200 len: 1298 microversion: 2.1 time: 0.189147 Apr 30 13:29:30.872324 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 768/1432] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:30 2021] GET /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021 => generated 1298 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:29:30.956308 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-1a3eb96d-91c7-470a-a0a3-ecd5f3cdeb22 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:30.966048 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-1a3eb96d-91c7-470a-a0a3-ecd5f3cdeb22 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:30.967565 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-1a3eb96d-91c7-470a-a0a3-ecd5f3cdeb22 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:30.968679 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-1a3eb96d-91c7-470a-a0a3-ecd5f3cdeb22 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.174541 Apr 30 13:29:30.969405 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 665/1433] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:29:30 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:29:31.125188 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-9b33090a-c145-423a-92d1-7bb78d8b07b6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:31.125860 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-9b33090a-c145-423a-92d1-7bb78d8b07b6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:31.134238 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9b33090a-c145-423a-92d1-7bb78d8b07b6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:31.134690 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9b33090a-c145-423a-92d1-7bb78d8b07b6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:31.135523 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9b33090a-c145-423a-92d1-7bb78d8b07b6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:31.135969 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9b33090a-c145-423a-92d1-7bb78d8b07b6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:31.342260 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-9b33090a-c145-423a-92d1-7bb78d8b07b6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:31.350603 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-9b33090a-c145-423a-92d1-7bb78d8b07b6 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.229196 Apr 30 13:29:31.351179 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 769/1434] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:31 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:29:31.888506 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-109b18a4-929c-4f09-afac-662812d6275f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:31.889109 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-109b18a4-929c-4f09-afac-662812d6275f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:31.898122 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-109b18a4-929c-4f09-afac-662812d6275f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:31.898586 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-109b18a4-929c-4f09-afac-662812d6275f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:31.899454 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-109b18a4-929c-4f09-afac-662812d6275f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:31.899875 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-109b18a4-929c-4f09-afac-662812d6275f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:31.987393 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-dd0a429f-809a-4add-a5c3-89d89fd59b26 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:31.987919 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-dd0a429f-809a-4add-a5c3-89d89fd59b26 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:31.995671 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-dd0a429f-809a-4add-a5c3-89d89fd59b26 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:31.996432 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-dd0a429f-809a-4add-a5c3-89d89fd59b26 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:31.997248 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-dd0a429f-809a-4add-a5c3-89d89fd59b26 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:31.997696 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-dd0a429f-809a-4add-a5c3-89d89fd59b26 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:32.118950 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-dd0a429f-809a-4add-a5c3-89d89fd59b26 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:32.128701 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-dd0a429f-809a-4add-a5c3-89d89fd59b26 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:32.130255 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-dd0a429f-809a-4add-a5c3-89d89fd59b26 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:32.131404 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-dd0a429f-809a-4add-a5c3-89d89fd59b26 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.148081 Apr 30 13:29:32.131966 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 770/1435] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:29:31 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:29:32.338120 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-109b18a4-929c-4f09-afac-662812d6275f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f2e072f58341ac85f9f856603b0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795985fdb0c545438436572c0f48ee24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:32.346881 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-109b18a4-929c-4f09-afac-662812d6275f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "GET /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021" status: 200 len: 1364 microversion: 2.1 time: 0.462043 Apr 30 13:29:32.347461 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 666/1436] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:31 2021] GET /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021 => generated 1364 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:29:32.368401 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-6057132f-83fc-4f8d-bae9-17d62ab2ef03 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:32.369023 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-6057132f-83fc-4f8d-bae9-17d62ab2ef03 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:32.377162 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6057132f-83fc-4f8d-bae9-17d62ab2ef03 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:32.377693 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6057132f-83fc-4f8d-bae9-17d62ab2ef03 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:32.378518 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6057132f-83fc-4f8d-bae9-17d62ab2ef03 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:32.378956 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6057132f-83fc-4f8d-bae9-17d62ab2ef03 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:32.592016 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-6057132f-83fc-4f8d-bae9-17d62ab2ef03 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:32.602775 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-6057132f-83fc-4f8d-bae9-17d62ab2ef03 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.238076 Apr 30 13:29:32.603358 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 771/1437] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:32 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:29:32.961368 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [req-8b7c91f3-7289-4fa8-a1de-ad4d1752dfd3 req-5879e420-6a4f-4d73-a354-840924eefb34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a50652a-d54a-4e55-a6cb-29c771123021", "tag": "2cf19fd2-d682-4274-b4cd-7c382cab30e5"}]} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:29:32.963587 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:29:32.963587 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: warnings.warn(msg) Apr 30 13:29:32.973848 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-8b7c91f3-7289-4fa8-a1de-ad4d1752dfd3 req-5879e420-6a4f-4d73-a354-840924eefb34 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:32.974620 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-8b7c91f3-7289-4fa8-a1de-ad4d1752dfd3 req-5879e420-6a4f-4d73-a354-840924eefb34 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:32.993641 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.compute.server_external_events [req-8b7c91f3-7289-4fa8-a1de-ad4d1752dfd3 req-5879e420-6a4f-4d73-a354-840924eefb34 service nova] Creating event network-changed:2cf19fd2-d682-4274-b4cd-7c382cab30e5 for instance 3a50652a-d54a-4e55-a6cb-29c771123021 on hv-cinder-78836 Apr 30 13:29:32.999043 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [req-8b7c91f3-7289-4fa8-a1de-ad4d1752dfd3 req-5879e420-6a4f-4d73-a354-840924eefb34 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043225 Apr 30 13:29:32.999754 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 667/1438] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:29:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:29:33.149202 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b7a68d29-6652-45ed-9b8a-56a9b35acd36 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:33.149868 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-b7a68d29-6652-45ed-9b8a-56a9b35acd36 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:33.158360 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b7a68d29-6652-45ed-9b8a-56a9b35acd36 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:33.158865 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b7a68d29-6652-45ed-9b8a-56a9b35acd36 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:33.159689 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b7a68d29-6652-45ed-9b8a-56a9b35acd36 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:33.160128 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b7a68d29-6652-45ed-9b8a-56a9b35acd36 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:33.288204 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-b7a68d29-6652-45ed-9b8a-56a9b35acd36 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:33.299002 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-b7a68d29-6652-45ed-9b8a-56a9b35acd36 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:33.300527 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-b7a68d29-6652-45ed-9b8a-56a9b35acd36 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:33.301661 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b7a68d29-6652-45ed-9b8a-56a9b35acd36 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.156392 Apr 30 13:29:33.302267 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 772/1439] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:29:33 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:29:33.364742 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-70ad1541-e0f6-437d-a406-35f3b001ed0a tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:33.365475 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-70ad1541-e0f6-437d-a406-35f3b001ed0a tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:33.373087 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-70ad1541-e0f6-437d-a406-35f3b001ed0a tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:33.373541 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-70ad1541-e0f6-437d-a406-35f3b001ed0a tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:33.374357 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-70ad1541-e0f6-437d-a406-35f3b001ed0a tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:33.374979 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-70ad1541-e0f6-437d-a406-35f3b001ed0a tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:33.621081 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-37917e59-e3a8-41ea-a694-6b4fc55c8f29 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:33.621702 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-37917e59-e3a8-41ea-a694-6b4fc55c8f29 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:33.629613 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-37917e59-e3a8-41ea-a694-6b4fc55c8f29 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:33.630099 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-37917e59-e3a8-41ea-a694-6b4fc55c8f29 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:33.630892 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-37917e59-e3a8-41ea-a694-6b4fc55c8f29 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:33.631343 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-37917e59-e3a8-41ea-a694-6b4fc55c8f29 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:33.721389 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-70ad1541-e0f6-437d-a406-35f3b001ed0a tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f2e072f58341ac85f9f856603b0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795985fdb0c545438436572c0f48ee24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:33.730371 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-70ad1541-e0f6-437d-a406-35f3b001ed0a tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "GET /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021" status: 200 len: 1364 microversion: 2.1 time: 0.369703 Apr 30 13:29:33.731071 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 668/1440] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:33 2021] GET /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021 => generated 1364 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:29:33.831850 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-37917e59-e3a8-41ea-a694-6b4fc55c8f29 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:33.840491 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-37917e59-e3a8-41ea-a694-6b4fc55c8f29 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.223155 Apr 30 13:29:33.841652 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 773/1441] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:33 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:29:34.327571 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-c73dfd50-e545-4330-a22c-d0f1fa065c1b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:34.328123 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-c73dfd50-e545-4330-a22c-d0f1fa065c1b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:34.336573 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c73dfd50-e545-4330-a22c-d0f1fa065c1b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:34.337033 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c73dfd50-e545-4330-a22c-d0f1fa065c1b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:34.337834 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c73dfd50-e545-4330-a22c-d0f1fa065c1b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:34.338305 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c73dfd50-e545-4330-a22c-d0f1fa065c1b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:34.569599 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-c73dfd50-e545-4330-a22c-d0f1fa065c1b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:34.581238 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-c73dfd50-e545-4330-a22c-d0f1fa065c1b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:34.582730 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-c73dfd50-e545-4330-a22c-d0f1fa065c1b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:34.584166 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-c73dfd50-e545-4330-a22c-d0f1fa065c1b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.260278 Apr 30 13:29:34.584740 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 669/1442] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:29:34 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:29:34.747949 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-026a5697-637e-4867-aeaf-d0e966b4102f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:34.748597 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-026a5697-637e-4867-aeaf-d0e966b4102f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:34.756549 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-026a5697-637e-4867-aeaf-d0e966b4102f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:34.757000 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-026a5697-637e-4867-aeaf-d0e966b4102f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:34.757788 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-026a5697-637e-4867-aeaf-d0e966b4102f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:34.758261 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-026a5697-637e-4867-aeaf-d0e966b4102f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:34.858427 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-38dbb865-6f4f-492a-8ed9-bff719512429 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:34.859035 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-38dbb865-6f4f-492a-8ed9-bff719512429 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:34.867608 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-38dbb865-6f4f-492a-8ed9-bff719512429 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:34.868074 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-38dbb865-6f4f-492a-8ed9-bff719512429 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:34.868869 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-38dbb865-6f4f-492a-8ed9-bff719512429 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:34.869320 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-38dbb865-6f4f-492a-8ed9-bff719512429 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:34.986366 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-026a5697-637e-4867-aeaf-d0e966b4102f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f2e072f58341ac85f9f856603b0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795985fdb0c545438436572c0f48ee24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:34.991177 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-026a5697-637e-4867-aeaf-d0e966b4102f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "GET /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021" status: 200 len: 1364 microversion: 2.1 time: 0.246978 Apr 30 13:29:34.998088 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 774/1443] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:34 2021] GET /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021 => generated 1364 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:29:35.088942 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-38dbb865-6f4f-492a-8ed9-bff719512429 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:35.097333 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-38dbb865-6f4f-492a-8ed9-bff719512429 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.242796 Apr 30 13:29:35.097897 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 670/1444] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:34 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:29:35.602998 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-6cc31d61-d472-4c49-8836-2e0734039f38 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:35.603621 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-6cc31d61-d472-4c49-8836-2e0734039f38 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:35.611176 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6cc31d61-d472-4c49-8836-2e0734039f38 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:35.611836 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6cc31d61-d472-4c49-8836-2e0734039f38 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:35.612696 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6cc31d61-d472-4c49-8836-2e0734039f38 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:35.613171 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6cc31d61-d472-4c49-8836-2e0734039f38 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:35.731760 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-6cc31d61-d472-4c49-8836-2e0734039f38 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:35.741467 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-6cc31d61-d472-4c49-8836-2e0734039f38 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:35.742995 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-6cc31d61-d472-4c49-8836-2e0734039f38 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:35.744292 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-6cc31d61-d472-4c49-8836-2e0734039f38 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.145117 Apr 30 13:29:35.744843 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 775/1445] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:29:35 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:29:36.008808 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-8824b365-e3f0-4eed-87bf-7fee62e25d7c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:36.009487 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-8824b365-e3f0-4eed-87bf-7fee62e25d7c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:36.016749 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8824b365-e3f0-4eed-87bf-7fee62e25d7c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:36.017201 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8824b365-e3f0-4eed-87bf-7fee62e25d7c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:36.019268 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8824b365-e3f0-4eed-87bf-7fee62e25d7c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:36.019596 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8824b365-e3f0-4eed-87bf-7fee62e25d7c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:36.115962 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-7cf54e94-0662-41bf-a67b-a772a44aab1d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:36.116487 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-7cf54e94-0662-41bf-a67b-a772a44aab1d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:36.133495 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7cf54e94-0662-41bf-a67b-a772a44aab1d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:36.134273 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7cf54e94-0662-41bf-a67b-a772a44aab1d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:36.135318 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7cf54e94-0662-41bf-a67b-a772a44aab1d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:36.135969 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7cf54e94-0662-41bf-a67b-a772a44aab1d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:36.254418 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-8824b365-e3f0-4eed-87bf-7fee62e25d7c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f2e072f58341ac85f9f856603b0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795985fdb0c545438436572c0f48ee24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:36.264140 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-8824b365-e3f0-4eed-87bf-7fee62e25d7c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "GET /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021" status: 200 len: 1364 microversion: 2.1 time: 0.259326 Apr 30 13:29:36.264724 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 671/1446] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:36 2021] GET /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021 => generated 1364 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:29:36.354186 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-7cf54e94-0662-41bf-a67b-a772a44aab1d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:36.363167 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-7cf54e94-0662-41bf-a67b-a772a44aab1d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.250978 Apr 30 13:29:36.363798 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 776/1447] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:36 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:29:36.762614 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-9977a6dc-58a9-4eb6-9fd3-2087450e6145 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:36.763225 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-9977a6dc-58a9-4eb6-9fd3-2087450e6145 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:36.770605 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9977a6dc-58a9-4eb6-9fd3-2087450e6145 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:36.771054 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9977a6dc-58a9-4eb6-9fd3-2087450e6145 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:36.771839 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9977a6dc-58a9-4eb6-9fd3-2087450e6145 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:36.772275 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9977a6dc-58a9-4eb6-9fd3-2087450e6145 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:36.893248 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-9977a6dc-58a9-4eb6-9fd3-2087450e6145 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:36.902528 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-9977a6dc-58a9-4eb6-9fd3-2087450e6145 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:36.904026 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-9977a6dc-58a9-4eb6-9fd3-2087450e6145 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:36.905131 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-9977a6dc-58a9-4eb6-9fd3-2087450e6145 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.146410 Apr 30 13:29:36.905696 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 672/1448] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:29:36 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:29:37.282336 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-a5acbca7-3a09-479c-9fa0-bc99266385c7 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:37.282962 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-a5acbca7-3a09-479c-9fa0-bc99266385c7 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:37.290686 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a5acbca7-3a09-479c-9fa0-bc99266385c7 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:37.291143 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a5acbca7-3a09-479c-9fa0-bc99266385c7 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:37.291931 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a5acbca7-3a09-479c-9fa0-bc99266385c7 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:37.292373 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a5acbca7-3a09-479c-9fa0-bc99266385c7 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:37.381161 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-510b37cc-da5a-4bf8-95cd-59627b67ac4e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:37.381792 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-510b37cc-da5a-4bf8-95cd-59627b67ac4e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:37.389608 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-510b37cc-da5a-4bf8-95cd-59627b67ac4e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:37.390096 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-510b37cc-da5a-4bf8-95cd-59627b67ac4e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:37.390899 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-510b37cc-da5a-4bf8-95cd-59627b67ac4e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:37.391345 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-510b37cc-da5a-4bf8-95cd-59627b67ac4e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:37.495897 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-a5acbca7-3a09-479c-9fa0-bc99266385c7 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f2e072f58341ac85f9f856603b0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795985fdb0c545438436572c0f48ee24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:37.504632 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-a5acbca7-3a09-479c-9fa0-bc99266385c7 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "GET /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021" status: 200 len: 1364 microversion: 2.1 time: 0.226019 Apr 30 13:29:37.505222 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 777/1449] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:37 2021] GET /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021 => generated 1364 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:29:37.592566 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-510b37cc-da5a-4bf8-95cd-59627b67ac4e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:37.601727 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-510b37cc-da5a-4bf8-95cd-59627b67ac4e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.225086 Apr 30 13:29:37.602413 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 673/1450] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:37 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:29:37.923362 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-4c221bc0-1c28-4f3c-a4c1-894272edc9a2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:37.924289 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-4c221bc0-1c28-4f3c-a4c1-894272edc9a2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:37.932427 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4c221bc0-1c28-4f3c-a4c1-894272edc9a2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:37.932884 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4c221bc0-1c28-4f3c-a4c1-894272edc9a2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:37.933680 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4c221bc0-1c28-4f3c-a4c1-894272edc9a2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:37.934159 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4c221bc0-1c28-4f3c-a4c1-894272edc9a2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:38.053351 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-4c221bc0-1c28-4f3c-a4c1-894272edc9a2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:38.063019 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-4c221bc0-1c28-4f3c-a4c1-894272edc9a2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:38.064781 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-4c221bc0-1c28-4f3c-a4c1-894272edc9a2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:38.065954 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-4c221bc0-1c28-4f3c-a4c1-894272edc9a2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.146412 Apr 30 13:29:38.066879 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 778/1451] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:29:37 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:29:38.350383 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [req-3ee9cfda-f747-4221-9a20-78831c57cd03 req-04817b7d-c78e-4a2f-a592-0c5e434a5fe7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a50652a-d54a-4e55-a6cb-29c771123021", "name": "network-vif-plugged", "status": "completed", "tag": "2cf19fd2-d682-4274-b4cd-7c382cab30e5"}]} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:29:38.352272 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:29:38.352272 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: warnings.warn(msg) Apr 30 13:29:38.362724 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-3ee9cfda-f747-4221-9a20-78831c57cd03 req-04817b7d-c78e-4a2f-a592-0c5e434a5fe7 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:38.363568 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-3ee9cfda-f747-4221-9a20-78831c57cd03 req-04817b7d-c78e-4a2f-a592-0c5e434a5fe7 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:38.380416 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.compute.server_external_events [req-3ee9cfda-f747-4221-9a20-78831c57cd03 req-04817b7d-c78e-4a2f-a592-0c5e434a5fe7 service nova] Creating event network-vif-plugged:2cf19fd2-d682-4274-b4cd-7c382cab30e5 for instance 3a50652a-d54a-4e55-a6cb-29c771123021 on hv-cinder-78836 Apr 30 13:29:38.385278 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [req-3ee9cfda-f747-4221-9a20-78831c57cd03 req-04817b7d-c78e-4a2f-a592-0c5e434a5fe7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136520 Apr 30 13:29:38.386100 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 674/1452] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:29:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:29:38.521648 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-3c97191c-805f-4a92-8a8e-e975ef3e408d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:38.522291 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-3c97191c-805f-4a92-8a8e-e975ef3e408d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:38.529756 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3c97191c-805f-4a92-8a8e-e975ef3e408d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:38.530254 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3c97191c-805f-4a92-8a8e-e975ef3e408d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:38.531046 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3c97191c-805f-4a92-8a8e-e975ef3e408d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:38.531482 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3c97191c-805f-4a92-8a8e-e975ef3e408d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:38.621385 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-aab19f57-924e-4c10-b622-8853166e0493 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:38.622177 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-aab19f57-924e-4c10-b622-8853166e0493 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:38.630513 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-aab19f57-924e-4c10-b622-8853166e0493 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:38.630973 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-aab19f57-924e-4c10-b622-8853166e0493 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:38.631772 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-aab19f57-924e-4c10-b622-8853166e0493 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:38.632218 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-aab19f57-924e-4c10-b622-8853166e0493 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:38.735334 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-3c97191c-805f-4a92-8a8e-e975ef3e408d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f2e072f58341ac85f9f856603b0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795985fdb0c545438436572c0f48ee24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:38.745178 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-3c97191c-805f-4a92-8a8e-e975ef3e408d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "GET /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021" status: 200 len: 1364 microversion: 2.1 time: 0.227882 Apr 30 13:29:38.745694 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 779/1453] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:38 2021] GET /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021 => generated 1364 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:29:38.845815 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-aab19f57-924e-4c10-b622-8853166e0493 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:38.855532 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-aab19f57-924e-4c10-b622-8853166e0493 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.238256 Apr 30 13:29:38.857750 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 675/1454] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:38 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:29:39.084235 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-d57fcec3-5777-43c6-bdda-2e949c186b64 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:39.084774 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-d57fcec3-5777-43c6-bdda-2e949c186b64 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:39.092197 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d57fcec3-5777-43c6-bdda-2e949c186b64 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:39.092661 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d57fcec3-5777-43c6-bdda-2e949c186b64 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:39.093450 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d57fcec3-5777-43c6-bdda-2e949c186b64 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:39.093903 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d57fcec3-5777-43c6-bdda-2e949c186b64 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:39.208068 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-d57fcec3-5777-43c6-bdda-2e949c186b64 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:39.218293 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-d57fcec3-5777-43c6-bdda-2e949c186b64 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:39.219826 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-d57fcec3-5777-43c6-bdda-2e949c186b64 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:39.221167 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-d57fcec3-5777-43c6-bdda-2e949c186b64 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.141386 Apr 30 13:29:39.221756 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 780/1455] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:29:39 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:29:39.761491 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-021458e6-150c-4bc8-885f-94aeb1b0be4e tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:39.762168 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-021458e6-150c-4bc8-885f-94aeb1b0be4e tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:39.769810 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-021458e6-150c-4bc8-885f-94aeb1b0be4e tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:39.770299 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-021458e6-150c-4bc8-885f-94aeb1b0be4e tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:39.771099 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-021458e6-150c-4bc8-885f-94aeb1b0be4e tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:39.771546 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-021458e6-150c-4bc8-885f-94aeb1b0be4e tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:39.878913 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-47377c0e-a09d-404f-b4ed-4ee07eb6eaed tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:39.879933 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-47377c0e-a09d-404f-b4ed-4ee07eb6eaed tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:39.895636 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-47377c0e-a09d-404f-b4ed-4ee07eb6eaed tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:39.896673 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-47377c0e-a09d-404f-b4ed-4ee07eb6eaed tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:39.899207 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-47377c0e-a09d-404f-b4ed-4ee07eb6eaed tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:39.900737 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-47377c0e-a09d-404f-b4ed-4ee07eb6eaed tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:39.987491 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-021458e6-150c-4bc8-885f-94aeb1b0be4e tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f2e072f58341ac85f9f856603b0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795985fdb0c545438436572c0f48ee24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:39.996092 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-021458e6-150c-4bc8-885f-94aeb1b0be4e tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "GET /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021" status: 200 len: 1364 microversion: 2.1 time: 0.238318 Apr 30 13:29:39.996668 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 676/1456] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:39 2021] GET /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021 => generated 1364 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:29:40.124716 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-47377c0e-a09d-404f-b4ed-4ee07eb6eaed tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:40.133195 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-47377c0e-a09d-404f-b4ed-4ee07eb6eaed tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.260822 Apr 30 13:29:40.133755 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 781/1457] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:39 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:29:40.239005 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-ef18bce4-aaf4-4ded-ae14-2ca1ca02ad95 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:40.239650 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-ef18bce4-aaf4-4ded-ae14-2ca1ca02ad95 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:40.247078 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ef18bce4-aaf4-4ded-ae14-2ca1ca02ad95 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:40.247536 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ef18bce4-aaf4-4ded-ae14-2ca1ca02ad95 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:40.248318 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ef18bce4-aaf4-4ded-ae14-2ca1ca02ad95 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:40.248760 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ef18bce4-aaf4-4ded-ae14-2ca1ca02ad95 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:40.365681 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-ef18bce4-aaf4-4ded-ae14-2ca1ca02ad95 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:40.374917 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-ef18bce4-aaf4-4ded-ae14-2ca1ca02ad95 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:40.376429 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-ef18bce4-aaf4-4ded-ae14-2ca1ca02ad95 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:40.377640 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-ef18bce4-aaf4-4ded-ae14-2ca1ca02ad95 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.142411 Apr 30 13:29:40.378235 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 677/1458] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:29:40 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:29:41.012916 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-5416655d-8b12-4876-8212-7e7555a17b1c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:41.013532 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-5416655d-8b12-4876-8212-7e7555a17b1c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:41.021322 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5416655d-8b12-4876-8212-7e7555a17b1c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:41.021777 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5416655d-8b12-4876-8212-7e7555a17b1c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:41.022596 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5416655d-8b12-4876-8212-7e7555a17b1c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:41.023033 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5416655d-8b12-4876-8212-7e7555a17b1c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:41.151282 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-bb94b124-2549-46f0-bb3a-1268cd585d0b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:41.151818 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-bb94b124-2549-46f0-bb3a-1268cd585d0b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:41.162644 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-bb94b124-2549-46f0-bb3a-1268cd585d0b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:41.163452 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-bb94b124-2549-46f0-bb3a-1268cd585d0b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:41.164865 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-bb94b124-2549-46f0-bb3a-1268cd585d0b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:41.165659 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-bb94b124-2549-46f0-bb3a-1268cd585d0b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:41.233660 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-5416655d-8b12-4876-8212-7e7555a17b1c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f2e072f58341ac85f9f856603b0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795985fdb0c545438436572c0f48ee24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:41.242804 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-5416655d-8b12-4876-8212-7e7555a17b1c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "GET /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021" status: 200 len: 1550 microversion: 2.1 time: 0.233711 Apr 30 13:29:41.243383 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 782/1459] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:41 2021] GET /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021 => generated 1550 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:29:41.259154 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-a21d3893-3dc0-4127-9139-1c69d8c59030 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:41.259657 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-a21d3893-3dc0-4127-9139-1c69d8c59030 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:41.267019 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a21d3893-3dc0-4127-9139-1c69d8c59030 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:41.267775 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a21d3893-3dc0-4127-9139-1c69d8c59030 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:41.268935 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a21d3893-3dc0-4127-9139-1c69d8c59030 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:41.269361 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a21d3893-3dc0-4127-9139-1c69d8c59030 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:41.384097 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-bb94b124-2549-46f0-bb3a-1268cd585d0b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:41.392891 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-bb94b124-2549-46f0-bb3a-1268cd585d0b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.245307 Apr 30 13:29:41.393771 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 678/1460] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:41 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:29:41.398220 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-5d0fe626-09f6-4e64-ad09-872683151bea tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:41.398967 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-5d0fe626-09f6-4e64-ad09-872683151bea tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:41.406448 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5d0fe626-09f6-4e64-ad09-872683151bea tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:41.406826 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5d0fe626-09f6-4e64-ad09-872683151bea tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:41.407622 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5d0fe626-09f6-4e64-ad09-872683151bea tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:41.409136 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5d0fe626-09f6-4e64-ad09-872683151bea tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:41.425332 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-a21d3893-3dc0-4127-9139-1c69d8c59030 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "GET /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.169484 Apr 30 13:29:41.425814 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 783/1461] 10.222.0.79 () {58 vars in 1275 bytes} [Fri Apr 30 13:29:41 2021] GET /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/os-interface => generated 284 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:29:41.536429 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-5d0fe626-09f6-4e64-ad09-872683151bea tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:41.545741 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-5d0fe626-09f6-4e64-ad09-872683151bea tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:41.547286 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-5d0fe626-09f6-4e64-ad09-872683151bea tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:41.549011 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-5d0fe626-09f6-4e64-ad09-872683151bea tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.153787 Apr 30 13:29:41.549814 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 679/1462] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:29:41 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:29:42.410875 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-3c3d9fc2-764a-4265-a8c2-2f655b03afd3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:42.411495 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-3c3d9fc2-764a-4265-a8c2-2f655b03afd3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:42.418958 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3c3d9fc2-764a-4265-a8c2-2f655b03afd3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:42.419402 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3c3d9fc2-764a-4265-a8c2-2f655b03afd3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:42.420181 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3c3d9fc2-764a-4265-a8c2-2f655b03afd3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:42.420617 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3c3d9fc2-764a-4265-a8c2-2f655b03afd3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:42.567477 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-169ff81b-3756-4769-bada-777b6c5baf1c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:42.568028 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-169ff81b-3756-4769-bada-777b6c5baf1c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:42.575428 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-169ff81b-3756-4769-bada-777b6c5baf1c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:42.575885 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-169ff81b-3756-4769-bada-777b6c5baf1c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:42.576684 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-169ff81b-3756-4769-bada-777b6c5baf1c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:42.577124 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-169ff81b-3756-4769-bada-777b6c5baf1c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:42.696887 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-169ff81b-3756-4769-bada-777b6c5baf1c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:42.707290 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-169ff81b-3756-4769-bada-777b6c5baf1c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:42.708927 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-169ff81b-3756-4769-bada-777b6c5baf1c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:42.710185 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-169ff81b-3756-4769-bada-777b6c5baf1c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1444 microversion: 2.20 time: 0.147226 Apr 30 13:29:42.710849 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 680/1463] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:29:42 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1444 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:29:42.957871 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-3c3d9fc2-764a-4265-a8c2-2f655b03afd3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:42.966197 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-3c3d9fc2-764a-4265-a8c2-2f655b03afd3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.559577 Apr 30 13:29:42.966961 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 784/1464] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:42 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:29:43.216043 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-5332a667-0b75-44f4-bfdc-6a42ea89b1f3 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:29:43.217106 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-5332a667-0b75-44f4-bfdc-6a42ea89b1f3 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:43.225951 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5332a667-0b75-44f4-bfdc-6a42ea89b1f3 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:43.226561 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5332a667-0b75-44f4-bfdc-6a42ea89b1f3 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:43.227587 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5332a667-0b75-44f4-bfdc-6a42ea89b1f3 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:43.228041 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5332a667-0b75-44f4-bfdc-6a42ea89b1f3 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:43.297346 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [req-d0edfa9b-b02d-4f30-adfc-4fc13624f29a req-4a67ca58-0184-42ec-b4a7-ce6b797d6f79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a50652a-d54a-4e55-a6cb-29c771123021", "tag": "2cf19fd2-d682-4274-b4cd-7c382cab30e5"}]} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:29:43.299250 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:29:43.299250 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: warnings.warn(msg) Apr 30 13:29:43.308152 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-d0edfa9b-b02d-4f30-adfc-4fc13624f29a req-4a67ca58-0184-42ec-b4a7-ce6b797d6f79 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:43.308747 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-d0edfa9b-b02d-4f30-adfc-4fc13624f29a req-4a67ca58-0184-42ec-b4a7-ce6b797d6f79 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:43.325276 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.compute.server_external_events [req-d0edfa9b-b02d-4f30-adfc-4fc13624f29a req-4a67ca58-0184-42ec-b4a7-ce6b797d6f79 service nova] Creating event network-changed:2cf19fd2-d682-4274-b4cd-7c382cab30e5 for instance 3a50652a-d54a-4e55-a6cb-29c771123021 on hv-cinder-78836 Apr 30 13:29:43.332244 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [req-d0edfa9b-b02d-4f30-adfc-4fc13624f29a req-4a67ca58-0184-42ec-b4a7-ce6b797d6f79 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109294 Apr 30 13:29:43.333292 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 785/1465] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:29:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:29:43.398944 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-5332a667-0b75-44f4-bfdc-6a42ea89b1f3 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action" status: 200 len: 14 microversion: 2.1 time: 0.186112 Apr 30 13:29:43.399884 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 681/1466] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:29:43 2021] POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action => generated 14 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 13:29:43.729101 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-9a6bec21-fd0b-432c-9148-bf8c4d6043b5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:43.729821 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-9a6bec21-fd0b-432c-9148-bf8c4d6043b5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:43.738441 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9a6bec21-fd0b-432c-9148-bf8c4d6043b5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:43.738924 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9a6bec21-fd0b-432c-9148-bf8c4d6043b5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:43.739712 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9a6bec21-fd0b-432c-9148-bf8c4d6043b5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:43.740172 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9a6bec21-fd0b-432c-9148-bf8c4d6043b5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:43.855384 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9a6bec21-fd0b-432c-9148-bf8c4d6043b5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:43.856013 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9a6bec21-fd0b-432c-9148-bf8c4d6043b5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:43.856654 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.objects.instance [None req-9a6bec21-fd0b-432c-9148-bf8c4d6043b5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lazy-loading 'fault' on Instance uuid ad3419a7-71af-4a52-bcb7-6048e0553df9 {{(pid=87933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:29:43.941933 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-9a6bec21-fd0b-432c-9148-bf8c4d6043b5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:43.952958 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-9a6bec21-fd0b-432c-9148-bf8c4d6043b5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:43.954441 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-9a6bec21-fd0b-432c-9148-bf8c4d6043b5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:43.956864 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-9a6bec21-fd0b-432c-9148-bf8c4d6043b5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 200 len: 1538 microversion: 2.20 time: 0.231863 Apr 30 13:29:43.958056 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 786/1467] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:29:43 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 1538 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:29:43.986625 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-e51bc84c-3000-4f04-a4e7-5e9e56ff106e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:43.988404 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-e51bc84c-3000-4f04-a4e7-5e9e56ff106e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:43.998771 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e51bc84c-3000-4f04-a4e7-5e9e56ff106e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:43.999936 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e51bc84c-3000-4f04-a4e7-5e9e56ff106e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:44.000908 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e51bc84c-3000-4f04-a4e7-5e9e56ff106e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:44.002358 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e51bc84c-3000-4f04-a4e7-5e9e56ff106e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:44.411720 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-1f896fdf-0f01-41ae-b80a-f5c4b316481f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:29:44.412788 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-1f896fdf-0f01-41ae-b80a-f5c4b316481f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:44.420812 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1f896fdf-0f01-41ae-b80a-f5c4b316481f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:44.421303 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1f896fdf-0f01-41ae-b80a-f5c4b316481f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:44.422218 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1f896fdf-0f01-41ae-b80a-f5c4b316481f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:44.422694 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1f896fdf-0f01-41ae-b80a-f5c4b316481f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:44.458631 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-e51bc84c-3000-4f04-a4e7-5e9e56ff106e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:44.479176 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-e51bc84c-3000-4f04-a4e7-5e9e56ff106e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.498240 Apr 30 13:29:44.480477 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 682/1468] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:43 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:29:44.553674 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-1f896fdf-0f01-41ae-b80a-f5c4b316481f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action" status: 200 len: 14 microversion: 2.1 time: 0.146795 Apr 30 13:29:44.554546 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 787/1469] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:29:44 2021] POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action => generated 14 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 30 13:29:44.976814 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-9108280e-970f-441b-a695-af8947a8045c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:44.977728 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-9108280e-970f-441b-a695-af8947a8045c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:44.988251 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9108280e-970f-441b-a695-af8947a8045c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:44.988251 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9108280e-970f-441b-a695-af8947a8045c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:44.988251 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9108280e-970f-441b-a695-af8947a8045c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:44.989584 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9108280e-970f-441b-a695-af8947a8045c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:45.044139 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.wsgi [None req-9108280e-970f-441b-a695-af8947a8045c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] HTTP exception thrown: Instance ad3419a7-71af-4a52-bcb7-6048e0553df9 could not be found. Apr 30 13:29:45.044844 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-9108280e-970f-441b-a695-af8947a8045c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Returning 404 to user: Instance ad3419a7-71af-4a52-bcb7-6048e0553df9 could not be found. {{(pid=87932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:29:45.045759 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-9108280e-970f-441b-a695-af8947a8045c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 404 len: 111 microversion: 2.20 time: 0.072772 Apr 30 13:29:45.046413 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 683/1470] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:29:44 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 30 13:29:45.055497 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-66cca514-3ce9-49dd-accd-900a007aa8b2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '.version_select at 0x7f74fb7a4af0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:45.074480 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-66cca514-3ce9-49dd-accd-900a007aa8b2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1812664701" status: 204 len: 0 microversion: 2.20 time: 0.023013 Apr 30 13:29:45.074990 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 788/1471] 10.222.0.79 () {60 vars in 1262 bytes} [Fri Apr 30 13:29:45 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1812664701 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 30 13:29:45.498648 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-5eec2724-d63f-4415-a395-41558595c725 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:45.499278 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-5eec2724-d63f-4415-a395-41558595c725 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:45.506984 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5eec2724-d63f-4415-a395-41558595c725 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:45.507482 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5eec2724-d63f-4415-a395-41558595c725 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:45.508305 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5eec2724-d63f-4415-a395-41558595c725 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:45.508749 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5eec2724-d63f-4415-a395-41558595c725 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:45.563923 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b0894305-70fa-43e3-b8b9-2a48d6762a2d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:29:45.565217 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-b0894305-70fa-43e3-b8b9-2a48d6762a2d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:45.573664 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b0894305-70fa-43e3-b8b9-2a48d6762a2d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:45.574153 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b0894305-70fa-43e3-b8b9-2a48d6762a2d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:45.574950 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b0894305-70fa-43e3-b8b9-2a48d6762a2d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:45.575452 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b0894305-70fa-43e3-b8b9-2a48d6762a2d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:45.701141 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b0894305-70fa-43e3-b8b9-2a48d6762a2d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action" status: 200 len: 14 microversion: 2.1 time: 0.140537 Apr 30 13:29:45.704659 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 789/1472] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:29:45 2021] POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 30 13:29:45.719039 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-5eec2724-d63f-4415-a395-41558595c725 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:45.728870 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-5eec2724-d63f-4415-a395-41558595c725 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.234388 Apr 30 13:29:45.729437 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 684/1473] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:45 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:29:46.179799 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-81802769-3eee-4926-a943-209e0f1f03ef tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'create', calling method: .version_select at 0x7f74fb7a4820>, body: {"keypair": {"name": "tempest-keypair-502429102"}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:29:46.205885 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.quota [None req-81802769-3eee-4926-a943-209e0f1f03ef tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Getting quotas for project 092cf09caa34460587230269b2e28a23. Resources: {'key_pairs'} {{(pid=87933) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:29:46.209926 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.quota [None req-81802769-3eee-4926-a943-209e0f1f03ef tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Getting quotas for user 1014c3ed5ee9414b96f591b3b397a981 and project 092cf09caa34460587230269b2e28a23. Resources: {'key_pairs'} {{(pid=87933) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:29:46.473064 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.quota [None req-81802769-3eee-4926-a943-209e0f1f03ef tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Getting quotas for project 092cf09caa34460587230269b2e28a23. Resources: {'key_pairs'} {{(pid=87933) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:29:46.476954 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.quota [None req-81802769-3eee-4926-a943-209e0f1f03ef tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Getting quotas for user 1014c3ed5ee9414b96f591b3b397a981 and project 092cf09caa34460587230269b2e28a23. Resources: {'key_pairs'} {{(pid=87933) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:29:46.490376 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-81802769-3eee-4926-a943-209e0f1f03ef tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.315984 Apr 30 13:29:46.490965 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 790/1474] 10.222.0.79 () {62 vars in 1199 bytes} [Fri Apr 30 13:29:46 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 318 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 30 13:29:46.712229 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-38757eb3-c6a5-4cbe-827a-b13139e4c964 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:29:46.713203 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-38757eb3-c6a5-4cbe-827a-b13139e4c964 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:46.721002 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-38757eb3-c6a5-4cbe-827a-b13139e4c964 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:46.721457 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-38757eb3-c6a5-4cbe-827a-b13139e4c964 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:46.722286 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-38757eb3-c6a5-4cbe-827a-b13139e4c964 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:46.722730 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-38757eb3-c6a5-4cbe-827a-b13139e4c964 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:46.747098 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-34d2465a-32a1-4c71-8d6b-76922d20c7b0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:46.748076 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-34d2465a-32a1-4c71-8d6b-76922d20c7b0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:46.756877 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-34d2465a-32a1-4c71-8d6b-76922d20c7b0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:46.757684 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-34d2465a-32a1-4c71-8d6b-76922d20c7b0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:46.758772 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-34d2465a-32a1-4c71-8d6b-76922d20c7b0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:46.759454 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-34d2465a-32a1-4c71-8d6b-76922d20c7b0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:46.851081 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-38757eb3-c6a5-4cbe-827a-b13139e4c964 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action" status: 200 len: 14 microversion: 2.1 time: 0.142571 Apr 30 13:29:46.855533 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 685/1475] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:29:46 2021] POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 13:29:46.979738 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-34d2465a-32a1-4c71-8d6b-76922d20c7b0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:46.989070 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-34d2465a-32a1-4c71-8d6b-76922d20c7b0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.246117 Apr 30 13:29:46.989655 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 791/1476] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:46 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:29:47.863873 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-68f61c39-0151-44fb-ad64-ab6233223ea4 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:29:47.864896 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-68f61c39-0151-44fb-ad64-ab6233223ea4 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:47.875928 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-68f61c39-0151-44fb-ad64-ab6233223ea4 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:47.877023 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-68f61c39-0151-44fb-ad64-ab6233223ea4 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:47.878228 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-68f61c39-0151-44fb-ad64-ab6233223ea4 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:47.878690 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-68f61c39-0151-44fb-ad64-ab6233223ea4 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:47.994571 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-68f61c39-0151-44fb-ad64-ab6233223ea4 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action" status: 200 len: 14 microversion: 2.1 time: 0.135298 Apr 30 13:29:47.995216 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 686/1477] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:29:47 2021] POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action => generated 14 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 13:29:48.006043 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-f286bef2-149e-4d52-b10c-3efba4f11da4 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:48.006756 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-f286bef2-149e-4d52-b10c-3efba4f11da4 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:48.014990 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f286bef2-149e-4d52-b10c-3efba4f11da4 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:48.015660 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f286bef2-149e-4d52-b10c-3efba4f11da4 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:48.016454 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f286bef2-149e-4d52-b10c-3efba4f11da4 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:48.016894 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f286bef2-149e-4d52-b10c-3efba4f11da4 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:48.224415 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-f286bef2-149e-4d52-b10c-3efba4f11da4 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:48.233271 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-f286bef2-149e-4d52-b10c-3efba4f11da4 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.231293 Apr 30 13:29:48.243520 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 792/1478] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:48 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:29:48.304743 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-8eed1484-a37c-4556-aa87-51f2c4dc71b0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-397765874", "imageRef": "705a0c6b-b003-4687-84bf-8b9f87dae39e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b393ed9b-4720-4bf4-967f-18d64ce498cd"}], "security_groups": [{"name": "tempest-securitygroup--61483942"}], "key_name": "tempest-keypair-502429102", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:29:48.437864 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.network.neutron [None req-8eed1484-a37c-4556-aa87-51f2c4dc71b0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] validate_networks() for [('b393ed9b-4720-4bf4-967f-18d64ce498cd', None, None, None)] {{(pid=87932) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 13:29:49.006422 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-4f6f13ed-555e-43d5-8dac-75389e449b57 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:29:49.007396 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-4f6f13ed-555e-43d5-8dac-75389e449b57 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:49.014815 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4f6f13ed-555e-43d5-8dac-75389e449b57 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:49.015269 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4f6f13ed-555e-43d5-8dac-75389e449b57 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:49.016055 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4f6f13ed-555e-43d5-8dac-75389e449b57 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:49.016490 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4f6f13ed-555e-43d5-8dac-75389e449b57 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:49.147283 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-8eed1484-a37c-4556-aa87-51f2c4dc71b0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Flavor limits 0:0:0 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 13:29:49.147769 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-8eed1484-a37c-4556-aa87-51f2c4dc71b0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Image limits 0:0:0 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 13:29:49.148208 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-8eed1484-a37c-4556-aa87-51f2c4dc71b0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Flavor pref 0:0:0 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 13:29:49.148663 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-8eed1484-a37c-4556-aa87-51f2c4dc71b0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Image pref 0:0:0 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 13:29:49.149078 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-8eed1484-a37c-4556-aa87-51f2c4dc71b0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 13:29:49.158446 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8eed1484-a37c-4556-aa87-51f2c4dc71b0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:49.158913 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8eed1484-a37c-4556-aa87-51f2c4dc71b0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:49.159735 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8eed1484-a37c-4556-aa87-51f2c4dc71b0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:49.160177 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8eed1484-a37c-4556-aa87-51f2c4dc71b0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:49.161091 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-4f6f13ed-555e-43d5-8dac-75389e449b57 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action" status: 200 len: 14 microversion: 2.1 time: 0.157959 Apr 30 13:29:49.161750 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 793/1479] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:29:49 2021] POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action => generated 14 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 30 13:29:49.177846 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.quota [None req-8eed1484-a37c-4556-aa87-51f2c4dc71b0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Getting quotas for project 092cf09caa34460587230269b2e28a23. Resources: {'ram', 'instances', 'cores'} {{(pid=87932) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:29:49.181870 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.quota [None req-8eed1484-a37c-4556-aa87-51f2c4dc71b0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Getting quotas for user 1014c3ed5ee9414b96f591b3b397a981 and project 092cf09caa34460587230269b2e28a23. Resources: {'ram', 'instances', 'cores'} {{(pid=87932) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:29:49.192643 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-8eed1484-a37c-4556-aa87-51f2c4dc71b0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Going to run 1 instances... {{(pid=87932) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 13:29:49.195095 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-8eed1484-a37c-4556-aa87-51f2c4dc71b0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='705a0c6b-b003-4687-84bf-8b9f87dae39e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=87932) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 13:29:49.238929 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8eed1484-a37c-4556-aa87-51f2c4dc71b0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [49312c69-6127-46ba-ac41-7cf728fe83ac] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 30 13:29:49.250788 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-57815d92-8140-4f2f-9d75-118723dad5c0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:49.251558 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-57815d92-8140-4f2f-9d75-118723dad5c0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:49.259885 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-57815d92-8140-4f2f-9d75-118723dad5c0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:49.260270 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-57815d92-8140-4f2f-9d75-118723dad5c0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:49.261051 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-57815d92-8140-4f2f-9d75-118723dad5c0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:49.262324 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-57815d92-8140-4f2f-9d75-118723dad5c0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:49.556277 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-57815d92-8140-4f2f-9d75-118723dad5c0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:49.565261 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-57815d92-8140-4f2f-9d75-118723dad5c0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.318726 Apr 30 13:29:49.565833 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 794/1480] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:49 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:29:50.172066 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-962b9852-3be0-4625-ae8e-74346e062aa7 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:29:50.172986 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-962b9852-3be0-4625-ae8e-74346e062aa7 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:50.181142 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-962b9852-3be0-4625-ae8e-74346e062aa7 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:50.181591 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-962b9852-3be0-4625-ae8e-74346e062aa7 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:50.182399 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-962b9852-3be0-4625-ae8e-74346e062aa7 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:50.182836 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-962b9852-3be0-4625-ae8e-74346e062aa7 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:50.256217 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO oslo.messaging._drivers.impl_rabbit [None req-8eed1484-a37c-4556-aa87-51f2c4dc71b0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [49312c69-6127-46ba-ac41-7cf728fe83ac] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 59958. Apr 30 13:29:50.260601 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-8eed1484-a37c-4556-aa87-51f2c4dc71b0 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 1.960632 Apr 30 13:29:50.261333 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 687/1481] 10.222.0.79 () {62 vars in 1188 bytes} [Fri Apr 30 13:29:48 2021] POST /compute/v2.1/servers => generated 400 bytes in 1962 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 30 13:29:50.271155 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-acea8327-cd6b-4bee-a49f-dc86327060d2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:50.271777 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-acea8327-cd6b-4bee-a49f-dc86327060d2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:50.305669 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-962b9852-3be0-4625-ae8e-74346e062aa7 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action" status: 200 len: 14 microversion: 2.1 time: 0.137143 Apr 30 13:29:50.306415 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 795/1482] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:29:50 2021] POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action => generated 14 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 30 13:29:50.345805 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-acea8327-cd6b-4bee-a49f-dc86327060d2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:50.354479 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-acea8327-cd6b-4bee-a49f-dc86327060d2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:50.355999 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-acea8327-cd6b-4bee-a49f-dc86327060d2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:50.357083 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-acea8327-cd6b-4bee-a49f-dc86327060d2 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781" status: 200 len: 1280 microversion: 2.20 time: 0.089799 Apr 30 13:29:50.357630 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 688/1483] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:29:50 2021] GET /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781 => generated 1280 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:29:50.583196 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-721c8430-39e8-4f88-93e5-53229fd546c4 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:50.583910 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-721c8430-39e8-4f88-93e5-53229fd546c4 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:50.592004 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-721c8430-39e8-4f88-93e5-53229fd546c4 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:50.592482 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-721c8430-39e8-4f88-93e5-53229fd546c4 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:50.593248 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-721c8430-39e8-4f88-93e5-53229fd546c4 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:50.593686 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-721c8430-39e8-4f88-93e5-53229fd546c4 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:50.819100 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-721c8430-39e8-4f88-93e5-53229fd546c4 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:50.831687 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-721c8430-39e8-4f88-93e5-53229fd546c4 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.253067 Apr 30 13:29:50.832241 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 796/1484] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:50 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:29:51.317386 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-73cda5c5-1b76-4e53-803a-363e1622be8d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:29:51.318399 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-73cda5c5-1b76-4e53-803a-363e1622be8d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:51.326463 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-73cda5c5-1b76-4e53-803a-363e1622be8d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:51.326901 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-73cda5c5-1b76-4e53-803a-363e1622be8d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:51.327686 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-73cda5c5-1b76-4e53-803a-363e1622be8d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:51.328124 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-73cda5c5-1b76-4e53-803a-363e1622be8d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:51.376076 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b49af381-822b-4336-9bb0-c69b0d218bc8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:51.378615 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-b49af381-822b-4336-9bb0-c69b0d218bc8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:51.386609 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b49af381-822b-4336-9bb0-c69b0d218bc8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:51.387190 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b49af381-822b-4336-9bb0-c69b0d218bc8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:51.388095 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b49af381-822b-4336-9bb0-c69b0d218bc8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:51.388602 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b49af381-822b-4336-9bb0-c69b0d218bc8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:51.452766 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-73cda5c5-1b76-4e53-803a-363e1622be8d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action" status: 200 len: 14 microversion: 2.1 time: 0.139737 Apr 30 13:29:51.453413 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 689/1485] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:29:51 2021] POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 13:29:51.519223 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-b49af381-822b-4336-9bb0-c69b0d218bc8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:51.528593 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-b49af381-822b-4336-9bb0-c69b0d218bc8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:51.530138 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-b49af381-822b-4336-9bb0-c69b0d218bc8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:51.531222 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b49af381-822b-4336-9bb0-c69b0d218bc8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781" status: 200 len: 1332 microversion: 2.20 time: 0.159746 Apr 30 13:29:51.531773 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 797/1486] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:29:51 2021] GET /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781 => generated 1332 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:29:51.851100 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-b3c2ef08-8f8c-47e0-93b4-474170ccfd6c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:51.852748 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-b3c2ef08-8f8c-47e0-93b4-474170ccfd6c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:51.863174 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b3c2ef08-8f8c-47e0-93b4-474170ccfd6c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:51.864715 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b3c2ef08-8f8c-47e0-93b4-474170ccfd6c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:51.865872 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b3c2ef08-8f8c-47e0-93b4-474170ccfd6c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:51.867477 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b3c2ef08-8f8c-47e0-93b4-474170ccfd6c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:52.143996 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-b3c2ef08-8f8c-47e0-93b4-474170ccfd6c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:52.152526 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-b3c2ef08-8f8c-47e0-93b4-474170ccfd6c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.305885 Apr 30 13:29:52.153161 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 690/1487] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:51 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:29:52.463961 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-25177f6d-3cc9-41eb-94c0-282334a75488 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:29:52.464962 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-25177f6d-3cc9-41eb-94c0-282334a75488 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:52.473930 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-25177f6d-3cc9-41eb-94c0-282334a75488 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:52.474318 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-25177f6d-3cc9-41eb-94c0-282334a75488 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:52.475128 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-25177f6d-3cc9-41eb-94c0-282334a75488 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:52.475577 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-25177f6d-3cc9-41eb-94c0-282334a75488 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:52.549264 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-872a7d98-a240-4eb0-98ed-ad6d3f0716b9 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:52.549888 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-872a7d98-a240-4eb0-98ed-ad6d3f0716b9 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:52.557307 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-872a7d98-a240-4eb0-98ed-ad6d3f0716b9 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:52.557755 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-872a7d98-a240-4eb0-98ed-ad6d3f0716b9 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:52.558709 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-872a7d98-a240-4eb0-98ed-ad6d3f0716b9 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:52.559146 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-872a7d98-a240-4eb0-98ed-ad6d3f0716b9 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:52.613115 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-25177f6d-3cc9-41eb-94c0-282334a75488 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action" status: 200 len: 9658 microversion: 2.1 time: 0.150639 Apr 30 13:29:52.618520 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 798/1488] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:29:52 2021] POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action => generated 9658 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:29:52.684203 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-872a7d98-a240-4eb0-98ed-ad6d3f0716b9 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:52.693583 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-872a7d98-a240-4eb0-98ed-ad6d3f0716b9 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:52.695254 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-872a7d98-a240-4eb0-98ed-ad6d3f0716b9 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:52.696804 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-872a7d98-a240-4eb0-98ed-ad6d3f0716b9 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781" status: 200 len: 1338 microversion: 2.20 time: 0.151814 Apr 30 13:29:52.697533 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 691/1489] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:29:52 2021] GET /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781 => generated 1338 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:29:53.171330 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-53ab31f3-5c5c-4207-8a51-e6956216a418 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:53.172052 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-53ab31f3-5c5c-4207-8a51-e6956216a418 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:53.180748 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-53ab31f3-5c5c-4207-8a51-e6956216a418 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:53.181203 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-53ab31f3-5c5c-4207-8a51-e6956216a418 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:53.182029 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-53ab31f3-5c5c-4207-8a51-e6956216a418 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:53.182474 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-53ab31f3-5c5c-4207-8a51-e6956216a418 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:53.390545 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-53ab31f3-5c5c-4207-8a51-e6956216a418 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:53.399356 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-53ab31f3-5c5c-4207-8a51-e6956216a418 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.232192 Apr 30 13:29:53.399988 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 799/1490] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:53 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:29:53.625246 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-645a5c76-1372-406a-8c9e-d6d795b1c00a tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:29:53.626314 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-645a5c76-1372-406a-8c9e-d6d795b1c00a tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:53.634864 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-645a5c76-1372-406a-8c9e-d6d795b1c00a tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:53.635548 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-645a5c76-1372-406a-8c9e-d6d795b1c00a tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:53.636405 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-645a5c76-1372-406a-8c9e-d6d795b1c00a tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:53.636851 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-645a5c76-1372-406a-8c9e-d6d795b1c00a tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:53.716319 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-e3040ca3-b39c-4eec-abfb-4b3fd622df69 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:53.716980 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-e3040ca3-b39c-4eec-abfb-4b3fd622df69 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:53.726285 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e3040ca3-b39c-4eec-abfb-4b3fd622df69 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:53.726737 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e3040ca3-b39c-4eec-abfb-4b3fd622df69 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:53.727537 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e3040ca3-b39c-4eec-abfb-4b3fd622df69 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:53.727981 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e3040ca3-b39c-4eec-abfb-4b3fd622df69 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:53.780676 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-645a5c76-1372-406a-8c9e-d6d795b1c00a tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action" status: 200 len: 17602 microversion: 2.1 time: 0.158901 Apr 30 13:29:53.785176 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 692/1491] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:29:53 2021] POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action => generated 17602 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 13:29:54.000101 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-e3040ca3-b39c-4eec-abfb-4b3fd622df69 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:54.010480 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-e3040ca3-b39c-4eec-abfb-4b3fd622df69 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:54.011998 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-e3040ca3-b39c-4eec-abfb-4b3fd622df69 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:54.013089 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-e3040ca3-b39c-4eec-abfb-4b3fd622df69 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781" status: 200 len: 1404 microversion: 2.20 time: 0.301593 Apr 30 13:29:54.013635 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 800/1492] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:29:53 2021] GET /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781 => generated 1404 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:29:54.031069 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [req-bd51429b-a3c8-418e-93fa-2abc8ea8fc92 req-db3f1391-2ccc-44c5-b8c5-aaddfab8aea8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7973333b-d5a8-4786-8b0b-e441a0743781", "tag": "b491a7a0-e823-4e08-9ba2-458449990f1b"}]} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:29:54.033347 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:29:54.033347 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: warnings.warn(msg) Apr 30 13:29:54.052965 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-bd51429b-a3c8-418e-93fa-2abc8ea8fc92 req-db3f1391-2ccc-44c5-b8c5-aaddfab8aea8 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:54.054522 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-bd51429b-a3c8-418e-93fa-2abc8ea8fc92 req-db3f1391-2ccc-44c5-b8c5-aaddfab8aea8 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:54.221994 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.compute.server_external_events [req-bd51429b-a3c8-418e-93fa-2abc8ea8fc92 req-db3f1391-2ccc-44c5-b8c5-aaddfab8aea8 service nova] Creating event network-changed:b491a7a0-e823-4e08-9ba2-458449990f1b for instance 7973333b-d5a8-4786-8b0b-e441a0743781 on hv-cinder-78836 Apr 30 13:29:54.226618 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [req-bd51429b-a3c8-418e-93fa-2abc8ea8fc92 req-db3f1391-2ccc-44c5-b8c5-aaddfab8aea8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.200350 Apr 30 13:29:54.227656 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 693/1493] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:29:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:29:54.417296 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-1cb36370-e8cc-4620-9ef5-feadf2130d47 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:54.418032 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-1cb36370-e8cc-4620-9ef5-feadf2130d47 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:54.427253 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1cb36370-e8cc-4620-9ef5-feadf2130d47 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:54.427740 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1cb36370-e8cc-4620-9ef5-feadf2130d47 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:54.428593 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1cb36370-e8cc-4620-9ef5-feadf2130d47 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:54.429060 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1cb36370-e8cc-4620-9ef5-feadf2130d47 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:54.636607 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-1cb36370-e8cc-4620-9ef5-feadf2130d47 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:54.645545 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-1cb36370-e8cc-4620-9ef5-feadf2130d47 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.232315 Apr 30 13:29:54.646359 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 801/1494] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:54 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:29:54.793298 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-f12b8586-abbf-4557-9562-edee8c5d984d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:29:54.794552 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-f12b8586-abbf-4557-9562-edee8c5d984d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:54.803760 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f12b8586-abbf-4557-9562-edee8c5d984d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:54.803760 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f12b8586-abbf-4557-9562-edee8c5d984d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:54.804677 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f12b8586-abbf-4557-9562-edee8c5d984d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:54.804956 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f12b8586-abbf-4557-9562-edee8c5d984d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:54.949254 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-f12b8586-abbf-4557-9562-edee8c5d984d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action" status: 200 len: 19024 microversion: 2.1 time: 0.159775 Apr 30 13:29:54.949966 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 694/1495] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:29:54 2021] POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action => generated 19024 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:29:55.031193 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-2db9dd51-8b99-442b-9691-4b420fc5f3e5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:55.031815 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-2db9dd51-8b99-442b-9691-4b420fc5f3e5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:55.039793 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2db9dd51-8b99-442b-9691-4b420fc5f3e5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:55.040259 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2db9dd51-8b99-442b-9691-4b420fc5f3e5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:55.041053 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2db9dd51-8b99-442b-9691-4b420fc5f3e5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:55.041501 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2db9dd51-8b99-442b-9691-4b420fc5f3e5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:55.250250 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-2db9dd51-8b99-442b-9691-4b420fc5f3e5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:55.260239 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-2db9dd51-8b99-442b-9691-4b420fc5f3e5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:55.261754 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-2db9dd51-8b99-442b-9691-4b420fc5f3e5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:55.262895 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-2db9dd51-8b99-442b-9691-4b420fc5f3e5 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781" status: 200 len: 1404 microversion: 2.20 time: 0.235479 Apr 30 13:29:55.263457 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 802/1496] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:29:55 2021] GET /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781 => generated 1404 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:29:55.663782 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-7e0ad06f-2e9e-47ef-87dd-7ef0ed6e39aa tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:55.664415 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-7e0ad06f-2e9e-47ef-87dd-7ef0ed6e39aa tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:55.672776 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7e0ad06f-2e9e-47ef-87dd-7ef0ed6e39aa tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:55.673323 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7e0ad06f-2e9e-47ef-87dd-7ef0ed6e39aa tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:55.674164 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7e0ad06f-2e9e-47ef-87dd-7ef0ed6e39aa tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:55.674614 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7e0ad06f-2e9e-47ef-87dd-7ef0ed6e39aa tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:55.960898 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-5aa57c36-5564-4af2-a748-466ff4f0220e tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:29:55.962101 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-5aa57c36-5564-4af2-a748-466ff4f0220e tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:55.970367 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5aa57c36-5564-4af2-a748-466ff4f0220e tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:55.970816 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5aa57c36-5564-4af2-a748-466ff4f0220e tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:55.971773 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5aa57c36-5564-4af2-a748-466ff4f0220e tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:55.972214 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5aa57c36-5564-4af2-a748-466ff4f0220e tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:56.012214 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-7e0ad06f-2e9e-47ef-87dd-7ef0ed6e39aa tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:56.022526 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-7e0ad06f-2e9e-47ef-87dd-7ef0ed6e39aa tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.363304 Apr 30 13:29:56.023945 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 695/1497] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:55 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:29:56.120943 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-5aa57c36-5564-4af2-a748-466ff4f0220e tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action" status: 200 len: 21233 microversion: 2.1 time: 0.163494 Apr 30 13:29:56.122055 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 803/1498] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:29:55 2021] POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action => generated 21233 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 13:29:56.281435 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-b1f336e8-89c9-4170-8e82-87b0ae2e654b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:56.282070 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-b1f336e8-89c9-4170-8e82-87b0ae2e654b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:56.290337 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b1f336e8-89c9-4170-8e82-87b0ae2e654b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:56.290790 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b1f336e8-89c9-4170-8e82-87b0ae2e654b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:56.291890 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b1f336e8-89c9-4170-8e82-87b0ae2e654b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:56.292316 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b1f336e8-89c9-4170-8e82-87b0ae2e654b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:56.716143 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-b1f336e8-89c9-4170-8e82-87b0ae2e654b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:56.726566 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-b1f336e8-89c9-4170-8e82-87b0ae2e654b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:56.728081 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-b1f336e8-89c9-4170-8e82-87b0ae2e654b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:56.729171 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-b1f336e8-89c9-4170-8e82-87b0ae2e654b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781" status: 200 len: 1404 microversion: 2.20 time: 0.451755 Apr 30 13:29:56.729726 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 696/1499] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:29:56 2021] GET /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781 => generated 1404 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:29:57.041159 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-47d9a271-acae-4fc4-b49d-7e60f3a464fd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:57.041852 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-47d9a271-acae-4fc4-b49d-7e60f3a464fd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:57.050606 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-47d9a271-acae-4fc4-b49d-7e60f3a464fd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:57.051060 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-47d9a271-acae-4fc4-b49d-7e60f3a464fd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:57.051878 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-47d9a271-acae-4fc4-b49d-7e60f3a464fd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:57.052311 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-47d9a271-acae-4fc4-b49d-7e60f3a464fd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:57.133591 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-f5a717ce-fd5b-4988-a1e9-4b19bee9e784 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:29:57.135813 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-f5a717ce-fd5b-4988-a1e9-4b19bee9e784 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:57.144921 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f5a717ce-fd5b-4988-a1e9-4b19bee9e784 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:57.145600 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f5a717ce-fd5b-4988-a1e9-4b19bee9e784 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:57.146937 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f5a717ce-fd5b-4988-a1e9-4b19bee9e784 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:57.147550 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f5a717ce-fd5b-4988-a1e9-4b19bee9e784 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:57.259885 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-47d9a271-acae-4fc4-b49d-7e60f3a464fd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:57.269095 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-47d9a271-acae-4fc4-b49d-7e60f3a464fd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.232073 Apr 30 13:29:57.269669 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 804/1500] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:57 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:29:57.277769 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-f5a717ce-fd5b-4988-a1e9-4b19bee9e784 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action" status: 200 len: 23140 microversion: 2.1 time: 0.148644 Apr 30 13:29:57.278455 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 697/1501] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:29:57 2021] POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action => generated 23140 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:29:57.747119 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-1c80a2ed-9dfd-4a54-be6e-bd8430dbc96a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:57.747784 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-1c80a2ed-9dfd-4a54-be6e-bd8430dbc96a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:57.756227 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1c80a2ed-9dfd-4a54-be6e-bd8430dbc96a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:57.756939 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1c80a2ed-9dfd-4a54-be6e-bd8430dbc96a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:57.757733 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1c80a2ed-9dfd-4a54-be6e-bd8430dbc96a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:57.758215 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1c80a2ed-9dfd-4a54-be6e-bd8430dbc96a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:57.961060 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-1c80a2ed-9dfd-4a54-be6e-bd8430dbc96a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:57.970305 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-1c80a2ed-9dfd-4a54-be6e-bd8430dbc96a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:57.972166 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-1c80a2ed-9dfd-4a54-be6e-bd8430dbc96a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:57.973318 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-1c80a2ed-9dfd-4a54-be6e-bd8430dbc96a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781" status: 200 len: 1404 microversion: 2.20 time: 0.230582 Apr 30 13:29:57.973884 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 805/1502] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:29:57 2021] GET /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781 => generated 1404 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:29:58.288169 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-2b5f4b79-d45d-46f7-9635-57387d396911 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:58.289736 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-2b5f4b79-d45d-46f7-9635-57387d396911 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:58.300861 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-d74bd66e-fe71-495e-80c8-d1cbce931626 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:29:58.304771 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-d74bd66e-fe71-495e-80c8-d1cbce931626 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:58.313413 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d74bd66e-fe71-495e-80c8-d1cbce931626 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:58.314667 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d74bd66e-fe71-495e-80c8-d1cbce931626 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:58.314793 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2b5f4b79-d45d-46f7-9635-57387d396911 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:58.315358 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2b5f4b79-d45d-46f7-9635-57387d396911 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:58.315773 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d74bd66e-fe71-495e-80c8-d1cbce931626 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:58.316311 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d74bd66e-fe71-495e-80c8-d1cbce931626 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:58.316433 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2b5f4b79-d45d-46f7-9635-57387d396911 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:58.316925 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2b5f4b79-d45d-46f7-9635-57387d396911 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:58.452553 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-d74bd66e-fe71-495e-80c8-d1cbce931626 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action" status: 200 len: 24466 microversion: 2.1 time: 0.156236 Apr 30 13:29:58.455888 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 806/1503] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:29:58 2021] POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action => generated 24466 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:29:58.528467 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-2b5f4b79-d45d-46f7-9635-57387d396911 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:58.539406 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-2b5f4b79-d45d-46f7-9635-57387d396911 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.255948 Apr 30 13:29:58.539991 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 698/1504] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:58 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:29:58.991789 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-3ad83245-ff3f-4376-89f0-7efc7440758f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:58.992412 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-3ad83245-ff3f-4376-89f0-7efc7440758f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:59.000591 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3ad83245-ff3f-4376-89f0-7efc7440758f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:59.001114 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3ad83245-ff3f-4376-89f0-7efc7440758f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:59.001924 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3ad83245-ff3f-4376-89f0-7efc7440758f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:59.002419 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3ad83245-ff3f-4376-89f0-7efc7440758f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:59.207655 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-3ad83245-ff3f-4376-89f0-7efc7440758f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:59.216476 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-3ad83245-ff3f-4376-89f0-7efc7440758f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:59.217992 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-3ad83245-ff3f-4376-89f0-7efc7440758f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:59.219106 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-3ad83245-ff3f-4376-89f0-7efc7440758f tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781" status: 200 len: 1404 microversion: 2.20 time: 0.231651 Apr 30 13:29:59.219673 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 807/1505] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:29:58 2021] GET /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781 => generated 1404 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:29:59.466830 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-999b9fbd-b8ba-4a03-9407-0eabb1cb773b tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:29:59.468370 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-999b9fbd-b8ba-4a03-9407-0eabb1cb773b tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:59.479991 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-999b9fbd-b8ba-4a03-9407-0eabb1cb773b tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:59.480583 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-999b9fbd-b8ba-4a03-9407-0eabb1cb773b tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:59.481631 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-999b9fbd-b8ba-4a03-9407-0eabb1cb773b tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:59.482121 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-999b9fbd-b8ba-4a03-9407-0eabb1cb773b tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:59.556795 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-01e031fd-a099-4f2c-9bbf-86d1b1697cd2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:29:59.557369 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-01e031fd-a099-4f2c-9bbf-86d1b1697cd2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:29:59.565411 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-01e031fd-a099-4f2c-9bbf-86d1b1697cd2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:59.565856 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-01e031fd-a099-4f2c-9bbf-86d1b1697cd2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:59.566661 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-01e031fd-a099-4f2c-9bbf-86d1b1697cd2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:29:59.567098 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-01e031fd-a099-4f2c-9bbf-86d1b1697cd2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:29:59.619970 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-999b9fbd-b8ba-4a03-9407-0eabb1cb773b tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action" status: 200 len: 25802 microversion: 2.1 time: 0.159458 Apr 30 13:29:59.620623 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 699/1506] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:29:59 2021] POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action => generated 25802 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:29:59.768851 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-01e031fd-a099-4f2c-9bbf-86d1b1697cd2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:29:59.777889 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-01e031fd-a099-4f2c-9bbf-86d1b1697cd2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.224960 Apr 30 13:29:59.778494 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 808/1507] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:29:59 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:30:00.237866 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-69692797-87b2-4444-baac-ef8691beb5cf tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:00.238661 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-69692797-87b2-4444-baac-ef8691beb5cf tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:00.247509 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-69692797-87b2-4444-baac-ef8691beb5cf tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:00.247966 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-69692797-87b2-4444-baac-ef8691beb5cf tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:00.248774 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-69692797-87b2-4444-baac-ef8691beb5cf tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:00.249220 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-69692797-87b2-4444-baac-ef8691beb5cf tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:00.397679 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [req-2d76f1fe-2c0c-420a-ab87-8588d3b063da req-b9240646-6ed4-475f-8be9-f152c60bed41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7973333b-d5a8-4786-8b0b-e441a0743781", "name": "network-vif-plugged", "status": "completed", "tag": "b491a7a0-e823-4e08-9ba2-458449990f1b"}]} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:00.399524 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:30:00.399524 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: warnings.warn(msg) Apr 30 13:30:00.429279 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-2d76f1fe-2c0c-420a-ab87-8588d3b063da req-b9240646-6ed4-475f-8be9-f152c60bed41 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:00.429727 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-2d76f1fe-2c0c-420a-ab87-8588d3b063da req-b9240646-6ed4-475f-8be9-f152c60bed41 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:00.481245 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.compute.server_external_events [req-2d76f1fe-2c0c-420a-ab87-8588d3b063da req-b9240646-6ed4-475f-8be9-f152c60bed41 service nova] Creating event network-vif-plugged:b491a7a0-e823-4e08-9ba2-458449990f1b for instance 7973333b-d5a8-4786-8b0b-e441a0743781 on hv-cinder-78836 Apr 30 13:30:00.489101 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [req-2d76f1fe-2c0c-420a-ab87-8588d3b063da req-b9240646-6ed4-475f-8be9-f152c60bed41 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096826 Apr 30 13:30:00.490227 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 809/1508] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:30:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:30:00.596905 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-69692797-87b2-4444-baac-ef8691beb5cf tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:00.606060 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-69692797-87b2-4444-baac-ef8691beb5cf tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:00.607595 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-69692797-87b2-4444-baac-ef8691beb5cf tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:00.608696 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-69692797-87b2-4444-baac-ef8691beb5cf tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781" status: 200 len: 1404 microversion: 2.20 time: 0.375370 Apr 30 13:30:00.609253 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 700/1509] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:30:00 2021] GET /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781 => generated 1404 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:30:00.632609 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b28f000b-ce83-4667-96c0-6514d99ca932 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:00.634157 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-b28f000b-ce83-4667-96c0-6514d99ca932 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:00.642631 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b28f000b-ce83-4667-96c0-6514d99ca932 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:00.643021 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b28f000b-ce83-4667-96c0-6514d99ca932 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:00.643827 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b28f000b-ce83-4667-96c0-6514d99ca932 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:00.644275 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b28f000b-ce83-4667-96c0-6514d99ca932 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:00.779640 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b28f000b-ce83-4667-96c0-6514d99ca932 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action" status: 200 len: 27129 microversion: 2.1 time: 0.151176 Apr 30 13:30:00.780327 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 810/1510] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:30:00 2021] POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action => generated 27129 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:30:00.794397 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-86dbee48-66da-4a06-ae91-3e4e420d48b9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:00.795026 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-86dbee48-66da-4a06-ae91-3e4e420d48b9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:00.802446 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-86dbee48-66da-4a06-ae91-3e4e420d48b9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:00.802902 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-86dbee48-66da-4a06-ae91-3e4e420d48b9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:00.803701 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-86dbee48-66da-4a06-ae91-3e4e420d48b9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:00.804141 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-86dbee48-66da-4a06-ae91-3e4e420d48b9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:01.011118 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-86dbee48-66da-4a06-ae91-3e4e420d48b9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:01.020681 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-86dbee48-66da-4a06-ae91-3e4e420d48b9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.230062 Apr 30 13:30:01.021333 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 701/1511] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:30:00 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:30:01.627002 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-dc6523b5-4ab3-40bf-b180-cad655f36b44 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:01.627799 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-dc6523b5-4ab3-40bf-b180-cad655f36b44 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:01.635958 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-dc6523b5-4ab3-40bf-b180-cad655f36b44 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:01.636605 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-dc6523b5-4ab3-40bf-b180-cad655f36b44 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:01.637189 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-dc6523b5-4ab3-40bf-b180-cad655f36b44 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:01.637633 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-dc6523b5-4ab3-40bf-b180-cad655f36b44 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:01.791921 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-679dfc3f-1ba4-4c4c-a36b-b866c689d8ab tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:01.792912 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-679dfc3f-1ba4-4c4c-a36b-b866c689d8ab tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:01.802445 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-679dfc3f-1ba4-4c4c-a36b-b866c689d8ab tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:01.802905 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-679dfc3f-1ba4-4c4c-a36b-b866c689d8ab tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:01.803711 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-679dfc3f-1ba4-4c4c-a36b-b866c689d8ab tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:01.804157 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-679dfc3f-1ba4-4c4c-a36b-b866c689d8ab tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:01.848687 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-dc6523b5-4ab3-40bf-b180-cad655f36b44 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:01.858286 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-dc6523b5-4ab3-40bf-b180-cad655f36b44 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:01.860110 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-dc6523b5-4ab3-40bf-b180-cad655f36b44 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:01.861970 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-dc6523b5-4ab3-40bf-b180-cad655f36b44 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781" status: 200 len: 1404 microversion: 2.20 time: 0.239778 Apr 30 13:30:01.863124 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 811/1512] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:30:01 2021] GET /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781 => generated 1404 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:30:01.977650 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-679dfc3f-1ba4-4c4c-a36b-b866c689d8ab tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action" status: 200 len: 27716 microversion: 2.1 time: 0.189320 Apr 30 13:30:01.978637 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 702/1513] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:30:01 2021] POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action => generated 27716 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 13:30:02.038539 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-ec8b31c1-656e-4084-bc7d-f0c9f21c6282 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:02.039152 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-ec8b31c1-656e-4084-bc7d-f0c9f21c6282 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:02.047042 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ec8b31c1-656e-4084-bc7d-f0c9f21c6282 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:02.047429 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ec8b31c1-656e-4084-bc7d-f0c9f21c6282 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:02.048813 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ec8b31c1-656e-4084-bc7d-f0c9f21c6282 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:02.049253 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ec8b31c1-656e-4084-bc7d-f0c9f21c6282 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:02.256190 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-ec8b31c1-656e-4084-bc7d-f0c9f21c6282 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:02.264635 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-ec8b31c1-656e-4084-bc7d-f0c9f21c6282 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.230360 Apr 30 13:30:02.265200 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 812/1514] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:30:02 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:30:02.883686 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-aa6d9164-534d-41c7-8cbd-3907ad949352 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:02.884388 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-aa6d9164-534d-41c7-8cbd-3907ad949352 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:02.892383 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-aa6d9164-534d-41c7-8cbd-3907ad949352 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:02.892821 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-aa6d9164-534d-41c7-8cbd-3907ad949352 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:02.893596 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-aa6d9164-534d-41c7-8cbd-3907ad949352 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:02.894060 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-aa6d9164-534d-41c7-8cbd-3907ad949352 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:02.990168 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-71a9f582-e4f7-488f-a7d6-cd088f60187c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:02.991228 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-71a9f582-e4f7-488f-a7d6-cd088f60187c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:02.999152 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-71a9f582-e4f7-488f-a7d6-cd088f60187c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:02.999585 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-71a9f582-e4f7-488f-a7d6-cd088f60187c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:03.000370 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-71a9f582-e4f7-488f-a7d6-cd088f60187c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:03.000840 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-71a9f582-e4f7-488f-a7d6-cd088f60187c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:03.100120 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-aa6d9164-534d-41c7-8cbd-3907ad949352 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:03.108903 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-aa6d9164-534d-41c7-8cbd-3907ad949352 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:03.111100 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-aa6d9164-534d-41c7-8cbd-3907ad949352 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:03.112337 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-aa6d9164-534d-41c7-8cbd-3907ad949352 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781" status: 200 len: 1595 microversion: 2.20 time: 0.232823 Apr 30 13:30:03.112901 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 703/1515] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:30:02 2021] GET /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781 => generated 1595 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:30:03.129464 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-a78f4d21-2674-4bb5-a3bc-3d03180a3bbc tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:03.129903 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-a78f4d21-2674-4bb5-a3bc-3d03180a3bbc tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:03.137345 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a78f4d21-2674-4bb5-a3bc-3d03180a3bbc tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:03.137804 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a78f4d21-2674-4bb5-a3bc-3d03180a3bbc tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:03.138635 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a78f4d21-2674-4bb5-a3bc-3d03180a3bbc tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:03.139086 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a78f4d21-2674-4bb5-a3bc-3d03180a3bbc tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:03.145411 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-71a9f582-e4f7-488f-a7d6-cd088f60187c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action" status: 200 len: 28135 microversion: 2.1 time: 0.159881 Apr 30 13:30:03.146099 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 813/1516] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:30:02 2021] POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action => generated 28135 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 13:30:03.283861 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-bb02e70e-8916-467f-b413-c8bda0af51ed tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:03.284573 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-bb02e70e-8916-467f-b413-c8bda0af51ed tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:03.284889 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-a78f4d21-2674-4bb5-a3bc-3d03180a3bbc tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.159141 Apr 30 13:30:03.285484 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 704/1517] 10.222.0.79 () {60 vars in 1316 bytes} [Fri Apr 30 13:30:03 2021] GET /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/os-interface => generated 284 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 13:30:03.293533 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-bb02e70e-8916-467f-b413-c8bda0af51ed tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:03.293999 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-bb02e70e-8916-467f-b413-c8bda0af51ed tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:03.294858 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-bb02e70e-8916-467f-b413-c8bda0af51ed tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:03.295306 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-bb02e70e-8916-467f-b413-c8bda0af51ed tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:03.852900 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-bb02e70e-8916-467f-b413-c8bda0af51ed tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:03.868047 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-bb02e70e-8916-467f-b413-c8bda0af51ed tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.588989 Apr 30 13:30:03.868925 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 814/1518] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:30:03 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:30:04.158137 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-1af62469-f9bd-4f71-aa4d-643b79667d51 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:04.159224 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-1af62469-f9bd-4f71-aa4d-643b79667d51 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:04.167802 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1af62469-f9bd-4f71-aa4d-643b79667d51 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:04.168254 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1af62469-f9bd-4f71-aa4d-643b79667d51 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:04.169097 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1af62469-f9bd-4f71-aa4d-643b79667d51 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:04.169542 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1af62469-f9bd-4f71-aa4d-643b79667d51 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:04.304071 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-1af62469-f9bd-4f71-aa4d-643b79667d51 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action" status: 200 len: 28197 microversion: 2.1 time: 0.150757 Apr 30 13:30:04.304728 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 705/1519] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:30:04 2021] POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action => generated 28197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:30:04.886993 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-ca069266-9a61-498e-b7bf-b116c55edb54 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:04.887590 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-ca069266-9a61-498e-b7bf-b116c55edb54 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:04.896133 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ca069266-9a61-498e-b7bf-b116c55edb54 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:04.896588 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ca069266-9a61-498e-b7bf-b116c55edb54 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:04.897374 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ca069266-9a61-498e-b7bf-b116c55edb54 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:04.897815 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ca069266-9a61-498e-b7bf-b116c55edb54 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:04.989107 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-11eee644-b2c0-48d5-96d9-210068dcc8af tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:04.990167 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-11eee644-b2c0-48d5-96d9-210068dcc8af tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:05.005043 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-11eee644-b2c0-48d5-96d9-210068dcc8af tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:05.005504 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-11eee644-b2c0-48d5-96d9-210068dcc8af tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:05.006345 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-11eee644-b2c0-48d5-96d9-210068dcc8af tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:05.006790 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-11eee644-b2c0-48d5-96d9-210068dcc8af tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:05.138582 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-11eee644-b2c0-48d5-96d9-210068dcc8af tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action" status: 200 len: 14 microversion: 2.20 time: 0.153603 Apr 30 13:30:05.142779 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 706/1520] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:30:04 2021] POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action => generated 14 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:30:05.149295 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [req-28efc14d-d354-4236-bf03-a8d245a87e2a req-99b00d6a-d3c1-4ed6-98b8-c79b37108674 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7973333b-d5a8-4786-8b0b-e441a0743781", "tag": "b491a7a0-e823-4e08-9ba2-458449990f1b"}]} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:05.150831 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:30:05.150831 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: warnings.warn(msg) Apr 30 13:30:05.159866 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-28efc14d-d354-4236-bf03-a8d245a87e2a req-99b00d6a-d3c1-4ed6-98b8-c79b37108674 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:05.160568 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-28efc14d-d354-4236-bf03-a8d245a87e2a req-99b00d6a-d3c1-4ed6-98b8-c79b37108674 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:05.177966 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.compute.server_external_events [req-28efc14d-d354-4236-bf03-a8d245a87e2a req-99b00d6a-d3c1-4ed6-98b8-c79b37108674 service nova] Creating event network-changed:b491a7a0-e823-4e08-9ba2-458449990f1b for instance 7973333b-d5a8-4786-8b0b-e441a0743781 on hv-cinder-78836 Apr 30 13:30:05.183885 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [req-28efc14d-d354-4236-bf03-a8d245a87e2a req-99b00d6a-d3c1-4ed6-98b8-c79b37108674 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041942 Apr 30 13:30:05.184860 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 707/1521] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:30:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:30:05.230375 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-ca069266-9a61-498e-b7bf-b116c55edb54 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:05.243369 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-ca069266-9a61-498e-b7bf-b116c55edb54 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.359851 Apr 30 13:30:05.254954 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 815/1522] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:30:04 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:30:05.317285 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-1beadec4-5bd5-4125-97d4-33e4fbd26ffb tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:05.318434 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-1beadec4-5bd5-4125-97d4-33e4fbd26ffb tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:05.326492 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1beadec4-5bd5-4125-97d4-33e4fbd26ffb tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:05.327275 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1beadec4-5bd5-4125-97d4-33e4fbd26ffb tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:05.328147 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1beadec4-5bd5-4125-97d4-33e4fbd26ffb tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:05.328668 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1beadec4-5bd5-4125-97d4-33e4fbd26ffb tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:05.465979 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-1beadec4-5bd5-4125-97d4-33e4fbd26ffb tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action" status: 200 len: 28488 microversion: 2.1 time: 0.153185 Apr 30 13:30:05.466656 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 708/1523] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:30:05 2021] POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action => generated 28488 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:30:06.150440 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-9684ee9f-fa9f-4719-a900-83f7e4760c94 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:06.151420 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-9684ee9f-fa9f-4719-a900-83f7e4760c94 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:06.159075 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9684ee9f-fa9f-4719-a900-83f7e4760c94 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:06.159582 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9684ee9f-fa9f-4719-a900-83f7e4760c94 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:06.160385 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9684ee9f-fa9f-4719-a900-83f7e4760c94 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:06.161089 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9684ee9f-fa9f-4719-a900-83f7e4760c94 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:06.262936 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-4c650f87-591a-4327-aac0-237ab7a37875 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:06.263660 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-4c650f87-591a-4327-aac0-237ab7a37875 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:06.272730 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4c650f87-591a-4327-aac0-237ab7a37875 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:06.273110 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4c650f87-591a-4327-aac0-237ab7a37875 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:06.273951 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4c650f87-591a-4327-aac0-237ab7a37875 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:06.274751 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4c650f87-591a-4327-aac0-237ab7a37875 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:06.291762 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-9684ee9f-fa9f-4719-a900-83f7e4760c94 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action" status: 200 len: 14 microversion: 2.20 time: 0.144969 Apr 30 13:30:06.292638 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 816/1524] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:30:06 2021] POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:30:06.479821 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-1aceb023-46f4-4282-9b02-7ca3a382518f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:06.481161 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-1aceb023-46f4-4282-9b02-7ca3a382518f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:06.483987 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-4c650f87-591a-4327-aac0-237ab7a37875 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:06.490197 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1aceb023-46f4-4282-9b02-7ca3a382518f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:06.490744 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1aceb023-46f4-4282-9b02-7ca3a382518f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:06.491646 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1aceb023-46f4-4282-9b02-7ca3a382518f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:06.492306 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1aceb023-46f4-4282-9b02-7ca3a382518f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:06.493469 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-4c650f87-591a-4327-aac0-237ab7a37875 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.234714 Apr 30 13:30:06.494066 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 709/1525] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:30:06 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:30:06.626749 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-1aceb023-46f4-4282-9b02-7ca3a382518f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action" status: 200 len: 28656 microversion: 2.1 time: 0.150535 Apr 30 13:30:06.627407 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 817/1526] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:30:06 2021] POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action => generated 28656 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 13:30:07.303439 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-1a396157-6134-4db6-9bb7-1504c1c3c7d3 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:07.304364 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-1a396157-6134-4db6-9bb7-1504c1c3c7d3 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:07.312216 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1a396157-6134-4db6-9bb7-1504c1c3c7d3 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:07.312675 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1a396157-6134-4db6-9bb7-1504c1c3c7d3 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:07.314302 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1a396157-6134-4db6-9bb7-1504c1c3c7d3 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:07.314752 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1a396157-6134-4db6-9bb7-1504c1c3c7d3 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:07.447760 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-1a396157-6134-4db6-9bb7-1504c1c3c7d3 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action" status: 200 len: 14 microversion: 2.20 time: 0.147892 Apr 30 13:30:07.448383 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 710/1527] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:30:07 2021] POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action => generated 14 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:30:07.512200 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-324d5b79-c9a6-4ef1-a61b-a5a469ac8b4f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:07.512902 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-324d5b79-c9a6-4ef1-a61b-a5a469ac8b4f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:07.521524 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-324d5b79-c9a6-4ef1-a61b-a5a469ac8b4f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:07.521970 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-324d5b79-c9a6-4ef1-a61b-a5a469ac8b4f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:07.522783 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-324d5b79-c9a6-4ef1-a61b-a5a469ac8b4f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:07.523218 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-324d5b79-c9a6-4ef1-a61b-a5a469ac8b4f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:07.639327 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-1bbbe7f4-d65e-4312-b3cf-a2c831fe0c1d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:07.640408 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-1bbbe7f4-d65e-4312-b3cf-a2c831fe0c1d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:07.648576 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1bbbe7f4-d65e-4312-b3cf-a2c831fe0c1d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:07.649039 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1bbbe7f4-d65e-4312-b3cf-a2c831fe0c1d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:07.649841 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1bbbe7f4-d65e-4312-b3cf-a2c831fe0c1d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:07.650313 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1bbbe7f4-d65e-4312-b3cf-a2c831fe0c1d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:07.731508 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-324d5b79-c9a6-4ef1-a61b-a5a469ac8b4f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:07.740631 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-324d5b79-c9a6-4ef1-a61b-a5a469ac8b4f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.232579 Apr 30 13:30:07.741194 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 818/1528] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:30:07 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:30:07.784364 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-1bbbe7f4-d65e-4312-b3cf-a2c831fe0c1d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action" status: 200 len: 28656 microversion: 2.1 time: 0.149077 Apr 30 13:30:07.785252 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 711/1529] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:30:07 2021] POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action => generated 28656 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:30:08.459690 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-04bd80f8-24d1-4a5c-b9a4-4b271d91fc23 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:08.460632 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-04bd80f8-24d1-4a5c-b9a4-4b271d91fc23 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:08.468146 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-04bd80f8-24d1-4a5c-b9a4-4b271d91fc23 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:08.468602 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-04bd80f8-24d1-4a5c-b9a4-4b271d91fc23 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:08.469384 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-04bd80f8-24d1-4a5c-b9a4-4b271d91fc23 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:08.469828 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-04bd80f8-24d1-4a5c-b9a4-4b271d91fc23 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:08.603622 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-04bd80f8-24d1-4a5c-b9a4-4b271d91fc23 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action" status: 200 len: 14 microversion: 2.20 time: 0.147496 Apr 30 13:30:08.604320 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 819/1530] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:30:08 2021] POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action => generated 14 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:30:08.758709 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-1a24a9e4-76f6-4f23-b913-4d61a8f44947 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:08.759417 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-1a24a9e4-76f6-4f23-b913-4d61a8f44947 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:08.767619 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1a24a9e4-76f6-4f23-b913-4d61a8f44947 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:08.768071 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1a24a9e4-76f6-4f23-b913-4d61a8f44947 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:08.768889 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1a24a9e4-76f6-4f23-b913-4d61a8f44947 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:08.769349 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1a24a9e4-76f6-4f23-b913-4d61a8f44947 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:08.798122 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b2f1fa12-fb66-478d-8e5b-5668c55c6113 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:08.799611 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-b2f1fa12-fb66-478d-8e5b-5668c55c6113 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:08.807470 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b2f1fa12-fb66-478d-8e5b-5668c55c6113 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:08.807932 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b2f1fa12-fb66-478d-8e5b-5668c55c6113 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:08.808790 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b2f1fa12-fb66-478d-8e5b-5668c55c6113 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:08.809238 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b2f1fa12-fb66-478d-8e5b-5668c55c6113 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:08.966225 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b2f1fa12-fb66-478d-8e5b-5668c55c6113 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action" status: 200 len: 28656 microversion: 2.1 time: 0.172996 Apr 30 13:30:08.970746 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 820/1531] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:30:08 2021] POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action => generated 28656 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 13:30:08.971057 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-1a24a9e4-76f6-4f23-b913-4d61a8f44947 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:08.980598 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-1a24a9e4-76f6-4f23-b913-4d61a8f44947 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.225959 Apr 30 13:30:08.981571 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 712/1532] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:30:08 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:30:09.615508 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-f34bb2f8-22dd-4619-9935-89ad24f18395 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:09.616430 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-f34bb2f8-22dd-4619-9935-89ad24f18395 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:09.624658 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f34bb2f8-22dd-4619-9935-89ad24f18395 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:09.625110 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f34bb2f8-22dd-4619-9935-89ad24f18395 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:09.625977 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f34bb2f8-22dd-4619-9935-89ad24f18395 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:09.626874 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f34bb2f8-22dd-4619-9935-89ad24f18395 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:09.747187 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-f34bb2f8-22dd-4619-9935-89ad24f18395 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action" status: 200 len: 14 microversion: 2.20 time: 0.135913 Apr 30 13:30:09.747813 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 821/1533] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:30:09 2021] POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:30:09.978654 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-aa03edc1-9e1b-4980-a42f-be11d481f61f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:09.979576 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-aa03edc1-9e1b-4980-a42f-be11d481f61f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:09.987512 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-aa03edc1-9e1b-4980-a42f-be11d481f61f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:09.988003 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-aa03edc1-9e1b-4980-a42f-be11d481f61f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:09.988779 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-aa03edc1-9e1b-4980-a42f-be11d481f61f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:09.989219 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-aa03edc1-9e1b-4980-a42f-be11d481f61f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:10.005682 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-21d2b7c3-e911-4d15-b596-fb8e0776c175 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:10.006517 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-21d2b7c3-e911-4d15-b596-fb8e0776c175 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:10.014453 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-21d2b7c3-e911-4d15-b596-fb8e0776c175 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:10.014902 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-21d2b7c3-e911-4d15-b596-fb8e0776c175 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:10.015681 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-21d2b7c3-e911-4d15-b596-fb8e0776c175 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:10.016124 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-21d2b7c3-e911-4d15-b596-fb8e0776c175 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:10.115492 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-aa03edc1-9e1b-4980-a42f-be11d481f61f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action" status: 200 len: 28656 microversion: 2.1 time: 0.140355 Apr 30 13:30:10.116267 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 713/1534] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:30:09 2021] POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action => generated 28656 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:30:10.223052 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-21d2b7c3-e911-4d15-b596-fb8e0776c175 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:10.231505 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-21d2b7c3-e911-4d15-b596-fb8e0776c175 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.230599 Apr 30 13:30:10.232104 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 822/1535] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:30:09 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:30:10.758968 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-8f61d917-fd44-451b-873c-741483dbff11 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:10.759895 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-8f61d917-fd44-451b-873c-741483dbff11 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:10.767929 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8f61d917-fd44-451b-873c-741483dbff11 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:10.768387 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8f61d917-fd44-451b-873c-741483dbff11 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:10.769280 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8f61d917-fd44-451b-873c-741483dbff11 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:10.769693 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8f61d917-fd44-451b-873c-741483dbff11 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:10.900896 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-8f61d917-fd44-451b-873c-741483dbff11 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action" status: 200 len: 14 microversion: 2.20 time: 0.145997 Apr 30 13:30:10.901561 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 714/1536] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:30:10 2021] POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:30:11.127737 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-d4f6335d-ea93-4168-aab1-1c98e3ab6bae tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:11.128569 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-d4f6335d-ea93-4168-aab1-1c98e3ab6bae tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:11.136641 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d4f6335d-ea93-4168-aab1-1c98e3ab6bae tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:11.137092 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d4f6335d-ea93-4168-aab1-1c98e3ab6bae tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:11.137868 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d4f6335d-ea93-4168-aab1-1c98e3ab6bae tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:11.138347 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d4f6335d-ea93-4168-aab1-1c98e3ab6bae tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:11.249180 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-599f2d8f-c59e-465e-a3a0-c3188a9468e3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:11.249874 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-599f2d8f-c59e-465e-a3a0-c3188a9468e3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:11.258615 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-599f2d8f-c59e-465e-a3a0-c3188a9468e3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:11.259062 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-599f2d8f-c59e-465e-a3a0-c3188a9468e3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:11.259843 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-599f2d8f-c59e-465e-a3a0-c3188a9468e3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:11.260283 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-599f2d8f-c59e-465e-a3a0-c3188a9468e3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:11.281790 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-d4f6335d-ea93-4168-aab1-1c98e3ab6bae tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action" status: 200 len: 29551 microversion: 2.1 time: 0.157714 Apr 30 13:30:11.282692 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 823/1537] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:30:11 2021] POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action => generated 29551 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:30:11.469980 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-599f2d8f-c59e-465e-a3a0-c3188a9468e3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:11.479365 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-599f2d8f-c59e-465e-a3a0-c3188a9468e3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.234243 Apr 30 13:30:11.482050 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 715/1538] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:30:11 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:30:11.913686 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-a42f66e9-612f-4c1f-bf37-4bf8b8647a92 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:11.914743 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-a42f66e9-612f-4c1f-bf37-4bf8b8647a92 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:11.924330 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a42f66e9-612f-4c1f-bf37-4bf8b8647a92 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:11.924786 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a42f66e9-612f-4c1f-bf37-4bf8b8647a92 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:11.925588 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a42f66e9-612f-4c1f-bf37-4bf8b8647a92 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:11.926045 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a42f66e9-612f-4c1f-bf37-4bf8b8647a92 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:12.063278 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-a42f66e9-612f-4c1f-bf37-4bf8b8647a92 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action" status: 200 len: 14 microversion: 2.20 time: 0.153697 Apr 30 13:30:12.064068 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 824/1539] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:30:11 2021] POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action => generated 14 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:30:12.294357 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-6a25fc4a-63a2-4ff7-bb03-51de72c6cfd3 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:12.295278 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-6a25fc4a-63a2-4ff7-bb03-51de72c6cfd3 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:12.304110 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6a25fc4a-63a2-4ff7-bb03-51de72c6cfd3 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:12.304562 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6a25fc4a-63a2-4ff7-bb03-51de72c6cfd3 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:12.305350 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6a25fc4a-63a2-4ff7-bb03-51de72c6cfd3 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:12.305794 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6a25fc4a-63a2-4ff7-bb03-51de72c6cfd3 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:12.456432 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-6a25fc4a-63a2-4ff7-bb03-51de72c6cfd3 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action" status: 200 len: 31649 microversion: 2.1 time: 0.165754 Apr 30 13:30:12.457068 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 716/1540] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:30:12 2021] POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action => generated 31649 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 13:30:12.497126 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-a5aacb93-c6a4-4711-a312-f7f177eae1dc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:12.498084 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-a5aacb93-c6a4-4711-a312-f7f177eae1dc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:12.506393 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a5aacb93-c6a4-4711-a312-f7f177eae1dc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:12.506855 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a5aacb93-c6a4-4711-a312-f7f177eae1dc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:12.507649 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a5aacb93-c6a4-4711-a312-f7f177eae1dc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:12.508091 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a5aacb93-c6a4-4711-a312-f7f177eae1dc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:12.711652 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-a5aacb93-c6a4-4711-a312-f7f177eae1dc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:12.720095 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-a5aacb93-c6a4-4711-a312-f7f177eae1dc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.227038 Apr 30 13:30:12.720660 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 825/1541] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:30:12 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:30:13.076425 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-8d5c40af-9f13-4e02-9da1-a6a8fc014c11 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:13.077429 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-8d5c40af-9f13-4e02-9da1-a6a8fc014c11 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:13.086342 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8d5c40af-9f13-4e02-9da1-a6a8fc014c11 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:13.086797 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8d5c40af-9f13-4e02-9da1-a6a8fc014c11 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:13.087622 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8d5c40af-9f13-4e02-9da1-a6a8fc014c11 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:13.088064 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8d5c40af-9f13-4e02-9da1-a6a8fc014c11 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:13.217683 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-8d5c40af-9f13-4e02-9da1-a6a8fc014c11 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action" status: 200 len: 14 microversion: 2.20 time: 0.145325 Apr 30 13:30:13.218363 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 717/1542] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:30:13 2021] POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:30:13.468497 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-80d592c1-7b8b-4cff-aded-3bed0721b53d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:13.469849 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-80d592c1-7b8b-4cff-aded-3bed0721b53d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:13.478065 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-80d592c1-7b8b-4cff-aded-3bed0721b53d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:13.478520 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-80d592c1-7b8b-4cff-aded-3bed0721b53d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:13.479296 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-80d592c1-7b8b-4cff-aded-3bed0721b53d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:13.479728 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-80d592c1-7b8b-4cff-aded-3bed0721b53d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:13.630747 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-80d592c1-7b8b-4cff-aded-3bed0721b53d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action" status: 200 len: 33153 microversion: 2.1 time: 0.166015 Apr 30 13:30:13.635802 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 826/1543] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:30:13 2021] POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action => generated 33153 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:30:13.740693 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-38cae4ab-aaff-4cf4-904c-2f162a28f363 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:13.741363 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-38cae4ab-aaff-4cf4-904c-2f162a28f363 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:13.749475 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-38cae4ab-aaff-4cf4-904c-2f162a28f363 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:13.749955 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-38cae4ab-aaff-4cf4-904c-2f162a28f363 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:13.750801 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-38cae4ab-aaff-4cf4-904c-2f162a28f363 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:13.751244 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-38cae4ab-aaff-4cf4-904c-2f162a28f363 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:13.951942 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-38cae4ab-aaff-4cf4-904c-2f162a28f363 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:13.966275 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-38cae4ab-aaff-4cf4-904c-2f162a28f363 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.232663 Apr 30 13:30:13.966861 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 718/1544] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:30:13 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:30:14.229311 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-107757f5-e9e7-4701-b6ab-37cc3275d190 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:14.230359 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-107757f5-e9e7-4701-b6ab-37cc3275d190 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:14.238676 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-107757f5-e9e7-4701-b6ab-37cc3275d190 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:14.239134 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-107757f5-e9e7-4701-b6ab-37cc3275d190 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:14.239930 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-107757f5-e9e7-4701-b6ab-37cc3275d190 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:14.240370 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-107757f5-e9e7-4701-b6ab-37cc3275d190 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:14.375098 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-107757f5-e9e7-4701-b6ab-37cc3275d190 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action" status: 200 len: 14 microversion: 2.20 time: 0.149822 Apr 30 13:30:14.376428 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 827/1545] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:30:14 2021] POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action => generated 14 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:30:14.643351 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-e81ef7da-0ceb-4480-a1dc-b0eff01e295b tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:14.644282 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-e81ef7da-0ceb-4480-a1dc-b0eff01e295b tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:14.651739 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e81ef7da-0ceb-4480-a1dc-b0eff01e295b tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:14.652198 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e81ef7da-0ceb-4480-a1dc-b0eff01e295b tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:14.652997 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e81ef7da-0ceb-4480-a1dc-b0eff01e295b tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:14.653446 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e81ef7da-0ceb-4480-a1dc-b0eff01e295b tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:14.814672 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-e81ef7da-0ceb-4480-a1dc-b0eff01e295b tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action" status: 200 len: 34035 microversion: 2.1 time: 0.173944 Apr 30 13:30:14.815313 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 719/1546] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:30:14 2021] POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action => generated 34035 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:30:14.984068 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-dced8e74-9814-41af-a393-94016510c538 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:14.984802 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-dced8e74-9814-41af-a393-94016510c538 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:14.993522 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-dced8e74-9814-41af-a393-94016510c538 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:14.993958 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-dced8e74-9814-41af-a393-94016510c538 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:14.994812 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-dced8e74-9814-41af-a393-94016510c538 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:14.995236 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-dced8e74-9814-41af-a393-94016510c538 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:15.223891 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-dced8e74-9814-41af-a393-94016510c538 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:15.232232 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-dced8e74-9814-41af-a393-94016510c538 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.252362 Apr 30 13:30:15.232856 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 828/1547] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:30:14 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:30:15.387769 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-748a88ab-c765-461c-a7ec-281939379f6d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:15.388772 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-748a88ab-c765-461c-a7ec-281939379f6d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:15.396802 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-748a88ab-c765-461c-a7ec-281939379f6d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:15.397250 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-748a88ab-c765-461c-a7ec-281939379f6d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:15.398044 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-748a88ab-c765-461c-a7ec-281939379f6d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:15.398485 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-748a88ab-c765-461c-a7ec-281939379f6d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:15.531524 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-748a88ab-c765-461c-a7ec-281939379f6d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action" status: 200 len: 8819 microversion: 2.20 time: 0.147765 Apr 30 13:30:15.532261 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 720/1548] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:30:15 2021] POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action => generated 8819 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:30:15.829802 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-45e0f242-65a6-45f0-83b6-8ec3395817ea tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:15.831142 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-45e0f242-65a6-45f0-83b6-8ec3395817ea tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:15.840663 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-45e0f242-65a6-45f0-83b6-8ec3395817ea tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:15.841960 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-45e0f242-65a6-45f0-83b6-8ec3395817ea tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:15.842917 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-45e0f242-65a6-45f0-83b6-8ec3395817ea tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:15.843473 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-45e0f242-65a6-45f0-83b6-8ec3395817ea tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:16.005726 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-45e0f242-65a6-45f0-83b6-8ec3395817ea tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action" status: 200 len: 34966 microversion: 2.1 time: 0.181140 Apr 30 13:30:16.006454 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 829/1549] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:30:15 2021] POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action => generated 34966 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:30:16.250903 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-78d0dde8-1092-485c-82c4-df37c84b93bb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:16.251661 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-78d0dde8-1092-485c-82c4-df37c84b93bb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:16.259976 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-78d0dde8-1092-485c-82c4-df37c84b93bb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:16.260428 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-78d0dde8-1092-485c-82c4-df37c84b93bb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:16.261215 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-78d0dde8-1092-485c-82c4-df37c84b93bb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:16.261660 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-78d0dde8-1092-485c-82c4-df37c84b93bb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:16.473975 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-78d0dde8-1092-485c-82c4-df37c84b93bb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:16.482518 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-78d0dde8-1092-485c-82c4-df37c84b93bb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.235992 Apr 30 13:30:16.483096 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 721/1550] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:30:16 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:30:16.543789 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-ae1b8c7d-a143-4c4c-adca-ca1965dd7efd tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:16.544735 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-ae1b8c7d-a143-4c4c-adca-ca1965dd7efd tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:16.553635 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ae1b8c7d-a143-4c4c-adca-ca1965dd7efd tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:16.554135 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ae1b8c7d-a143-4c4c-adca-ca1965dd7efd tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:16.554930 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ae1b8c7d-a143-4c4c-adca-ca1965dd7efd tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:16.555378 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ae1b8c7d-a143-4c4c-adca-ca1965dd7efd tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:16.681374 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-ae1b8c7d-a143-4c4c-adca-ca1965dd7efd tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action" status: 200 len: 16280 microversion: 2.20 time: 0.141698 Apr 30 13:30:16.682132 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 830/1551] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:30:16 2021] POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action => generated 16280 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:30:17.018057 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-072d30af-d0b0-45d6-8588-9c4411386626 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:17.018971 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-072d30af-d0b0-45d6-8588-9c4411386626 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:17.026233 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-072d30af-d0b0-45d6-8588-9c4411386626 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:17.026682 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-072d30af-d0b0-45d6-8588-9c4411386626 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:17.027450 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-072d30af-d0b0-45d6-8588-9c4411386626 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:17.027882 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-072d30af-d0b0-45d6-8588-9c4411386626 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:17.158948 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-072d30af-d0b0-45d6-8588-9c4411386626 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action" status: 200 len: 36246 microversion: 2.1 time: 0.144854 Apr 30 13:30:17.159633 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 722/1552] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:30:17 2021] POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action => generated 36246 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:30:17.505433 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-76b8db90-d8cc-4a67-a0f5-c5907fa3cb1d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:17.506187 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-76b8db90-d8cc-4a67-a0f5-c5907fa3cb1d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:17.517359 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-76b8db90-d8cc-4a67-a0f5-c5907fa3cb1d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:17.517678 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-76b8db90-d8cc-4a67-a0f5-c5907fa3cb1d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:17.518418 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-76b8db90-d8cc-4a67-a0f5-c5907fa3cb1d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:17.518869 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-76b8db90-d8cc-4a67-a0f5-c5907fa3cb1d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:17.696441 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-c16fc773-7886-405a-94ca-287958a51e77 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:17.697813 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-c16fc773-7886-405a-94ca-287958a51e77 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:17.709002 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c16fc773-7886-405a-94ca-287958a51e77 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:17.709456 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c16fc773-7886-405a-94ca-287958a51e77 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:17.710438 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c16fc773-7886-405a-94ca-287958a51e77 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:17.710987 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c16fc773-7886-405a-94ca-287958a51e77 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:17.788702 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-76b8db90-d8cc-4a67-a0f5-c5907fa3cb1d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:17.799264 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-76b8db90-d8cc-4a67-a0f5-c5907fa3cb1d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.299123 Apr 30 13:30:17.799264 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 831/1553] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:30:17 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:30:17.877563 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-c16fc773-7886-405a-94ca-287958a51e77 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action" status: 200 len: 18398 microversion: 2.20 time: 0.187218 Apr 30 13:30:17.878255 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 723/1554] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:30:17 2021] POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action => generated 18398 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 30 13:30:18.171816 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-8d303f8d-42a8-4add-9f45-144fcddcab5c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:18.173408 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-8d303f8d-42a8-4add-9f45-144fcddcab5c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:18.180865 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8d303f8d-42a8-4add-9f45-144fcddcab5c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:18.181320 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8d303f8d-42a8-4add-9f45-144fcddcab5c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:18.182125 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8d303f8d-42a8-4add-9f45-144fcddcab5c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:18.182570 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8d303f8d-42a8-4add-9f45-144fcddcab5c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:18.340837 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-8d303f8d-42a8-4add-9f45-144fcddcab5c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action" status: 200 len: 37764 microversion: 2.1 time: 0.172397 Apr 30 13:30:18.341414 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 832/1555] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:30:18 2021] POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action => generated 37764 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:30:18.823759 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-8bb35f20-f09c-4d0c-9dd2-b5812c61ffac tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:18.824945 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-8bb35f20-f09c-4d0c-9dd2-b5812c61ffac tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:18.840444 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8bb35f20-f09c-4d0c-9dd2-b5812c61ffac tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:18.841265 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8bb35f20-f09c-4d0c-9dd2-b5812c61ffac tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:18.842716 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8bb35f20-f09c-4d0c-9dd2-b5812c61ffac tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:18.843506 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8bb35f20-f09c-4d0c-9dd2-b5812c61ffac tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:18.889544 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-ca89b2a7-3af2-4604-8b91-bbc1bcc4f5a6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:18.890614 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-ca89b2a7-3af2-4604-8b91-bbc1bcc4f5a6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:18.899460 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ca89b2a7-3af2-4604-8b91-bbc1bcc4f5a6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:18.899922 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ca89b2a7-3af2-4604-8b91-bbc1bcc4f5a6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:18.900728 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ca89b2a7-3af2-4604-8b91-bbc1bcc4f5a6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:18.901177 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ca89b2a7-3af2-4604-8b91-bbc1bcc4f5a6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:19.036263 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-ca89b2a7-3af2-4604-8b91-bbc1bcc4f5a6 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action" status: 200 len: 20675 microversion: 2.20 time: 0.150421 Apr 30 13:30:19.036930 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 833/1556] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:30:18 2021] POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action => generated 20675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 30 13:30:19.174485 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-8bb35f20-f09c-4d0c-9dd2-b5812c61ffac tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:19.183060 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-8bb35f20-f09c-4d0c-9dd2-b5812c61ffac tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.366675 Apr 30 13:30:19.183834 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 724/1557] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:30:18 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:30:19.354065 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-428e834e-03f7-43fc-b35c-3a83c81b530d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:19.355074 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-428e834e-03f7-43fc-b35c-3a83c81b530d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:19.364220 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-428e834e-03f7-43fc-b35c-3a83c81b530d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:19.364668 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-428e834e-03f7-43fc-b35c-3a83c81b530d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:19.365460 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-428e834e-03f7-43fc-b35c-3a83c81b530d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:19.365897 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-428e834e-03f7-43fc-b35c-3a83c81b530d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:19.500002 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-428e834e-03f7-43fc-b35c-3a83c81b530d tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action" status: 200 len: 38190 microversion: 2.1 time: 0.150190 Apr 30 13:30:19.500831 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 834/1558] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:30:19 2021] POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action => generated 38190 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:30:20.047179 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-9972eeac-e916-4488-b9a9-ad7563ae1780 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:20.048108 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-9972eeac-e916-4488-b9a9-ad7563ae1780 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:20.055877 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9972eeac-e916-4488-b9a9-ad7563ae1780 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:20.056337 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9972eeac-e916-4488-b9a9-ad7563ae1780 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:20.057124 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9972eeac-e916-4488-b9a9-ad7563ae1780 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:20.057565 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9972eeac-e916-4488-b9a9-ad7563ae1780 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:20.187063 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-9972eeac-e916-4488-b9a9-ad7563ae1780 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action" status: 200 len: 22897 microversion: 2.20 time: 0.143493 Apr 30 13:30:20.189147 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 725/1559] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:30:20 2021] POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action => generated 22897 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 30 13:30:20.201070 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-87c6f7b6-7553-421b-a4cb-4e9a50de0e13 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:20.202026 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-87c6f7b6-7553-421b-a4cb-4e9a50de0e13 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:20.211020 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-87c6f7b6-7553-421b-a4cb-4e9a50de0e13 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:20.211558 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-87c6f7b6-7553-421b-a4cb-4e9a50de0e13 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:20.212532 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-87c6f7b6-7553-421b-a4cb-4e9a50de0e13 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:20.213036 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-87c6f7b6-7553-421b-a4cb-4e9a50de0e13 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:20.415809 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-87c6f7b6-7553-421b-a4cb-4e9a50de0e13 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:20.424152 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-87c6f7b6-7553-421b-a4cb-4e9a50de0e13 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.227287 Apr 30 13:30:20.424727 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 835/1560] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:30:20 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:30:20.513862 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-15c82c9c-fd5d-4ed2-895f-608bf5b46c4f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:20.514810 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-15c82c9c-fd5d-4ed2-895f-608bf5b46c4f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:20.523598 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-15c82c9c-fd5d-4ed2-895f-608bf5b46c4f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:20.524056 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-15c82c9c-fd5d-4ed2-895f-608bf5b46c4f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:20.524853 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-15c82c9c-fd5d-4ed2-895f-608bf5b46c4f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:20.525303 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-15c82c9c-fd5d-4ed2-895f-608bf5b46c4f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:20.649045 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-15c82c9c-fd5d-4ed2-895f-608bf5b46c4f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action" status: 200 len: 38190 microversion: 2.1 time: 0.139268 Apr 30 13:30:20.650293 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 726/1561] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:30:20 2021] POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action => generated 38190 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:30:21.199757 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-2ef00b3e-9460-47b9-8f8d-b8a97ac77fc1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:21.200716 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-2ef00b3e-9460-47b9-8f8d-b8a97ac77fc1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:21.209372 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2ef00b3e-9460-47b9-8f8d-b8a97ac77fc1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:21.210043 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2ef00b3e-9460-47b9-8f8d-b8a97ac77fc1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:21.210662 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2ef00b3e-9460-47b9-8f8d-b8a97ac77fc1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:21.211106 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2ef00b3e-9460-47b9-8f8d-b8a97ac77fc1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:21.342562 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-2ef00b3e-9460-47b9-8f8d-b8a97ac77fc1 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action" status: 200 len: 24479 microversion: 2.20 time: 0.146468 Apr 30 13:30:21.343344 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 836/1562] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:30:21 2021] POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action => generated 24479 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:30:21.442597 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-2d1527b3-fc36-48d1-a16f-1882c45f34eb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:21.443305 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-2d1527b3-fc36-48d1-a16f-1882c45f34eb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:21.451408 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2d1527b3-fc36-48d1-a16f-1882c45f34eb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:21.451792 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2d1527b3-fc36-48d1-a16f-1882c45f34eb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:21.452569 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2d1527b3-fc36-48d1-a16f-1882c45f34eb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:21.453003 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2d1527b3-fc36-48d1-a16f-1882c45f34eb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:21.655175 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-2d1527b3-fc36-48d1-a16f-1882c45f34eb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:21.662534 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-d5084380-1b1c-4676-8ce6-4b74c489b127 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:21.663570 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-d5084380-1b1c-4676-8ce6-4b74c489b127 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:21.664959 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-2d1527b3-fc36-48d1-a16f-1882c45f34eb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1562 microversion: 2.1 time: 0.227206 Apr 30 13:30:21.665550 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 727/1563] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:30:21 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1562 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:30:21.671712 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d5084380-1b1c-4676-8ce6-4b74c489b127 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:21.672215 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d5084380-1b1c-4676-8ce6-4b74c489b127 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:21.673014 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d5084380-1b1c-4676-8ce6-4b74c489b127 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:21.673477 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d5084380-1b1c-4676-8ce6-4b74c489b127 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:21.792468 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-d5084380-1b1c-4676-8ce6-4b74c489b127 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action" status: 200 len: 38190 microversion: 2.1 time: 0.134918 Apr 30 13:30:21.793164 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 837/1564] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:30:21 2021] POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action => generated 38190 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 13:30:22.354619 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-8200b23f-3c86-4b48-80bd-97fdb28f3291 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:22.355644 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-8200b23f-3c86-4b48-80bd-97fdb28f3291 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:22.364097 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8200b23f-3c86-4b48-80bd-97fdb28f3291 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:22.364558 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8200b23f-3c86-4b48-80bd-97fdb28f3291 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:22.365363 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8200b23f-3c86-4b48-80bd-97fdb28f3291 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:22.365812 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8200b23f-3c86-4b48-80bd-97fdb28f3291 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:22.497245 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-8200b23f-3c86-4b48-80bd-97fdb28f3291 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action" status: 200 len: 26222 microversion: 2.20 time: 0.146242 Apr 30 13:30:22.499133 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 728/1565] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:30:22 2021] POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action => generated 26222 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:30:22.807159 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-768f7a7f-5a86-4218-8bbc-c0a4bcbf451c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:22.808863 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-768f7a7f-5a86-4218-8bbc-c0a4bcbf451c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:22.817706 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-768f7a7f-5a86-4218-8bbc-c0a4bcbf451c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:22.818211 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-768f7a7f-5a86-4218-8bbc-c0a4bcbf451c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:22.819019 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-768f7a7f-5a86-4218-8bbc-c0a4bcbf451c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:22.819465 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-768f7a7f-5a86-4218-8bbc-c0a4bcbf451c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:22.948936 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-768f7a7f-5a86-4218-8bbc-c0a4bcbf451c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action" status: 200 len: 38321 microversion: 2.1 time: 0.145773 Apr 30 13:30:22.954263 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 838/1566] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:30:22 2021] POST /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/action => generated 38321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 30 13:30:22.959838 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-9eeb1878-e1f2-4d82-b465-dbcde89a69ba tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:22.960560 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-9eeb1878-e1f2-4d82-b465-dbcde89a69ba tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:22.968628 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9eeb1878-e1f2-4d82-b465-dbcde89a69ba tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:22.969082 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9eeb1878-e1f2-4d82-b465-dbcde89a69ba tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:22.969863 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9eeb1878-e1f2-4d82-b465-dbcde89a69ba tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:22.970628 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9eeb1878-e1f2-4d82-b465-dbcde89a69ba tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:23.032296 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-9eeb1878-e1f2-4d82-b465-dbcde89a69ba tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "GET /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/ips" status: 200 len: 146 microversion: 2.1 time: 0.076198 Apr 30 13:30:23.033052 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 729/1567] 10.222.0.79 () {58 vars in 1248 bytes} [Fri Apr 30 13:30:22 2021] GET /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021/ips => generated 146 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:30:23.207626 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-588a2949-e92f-453b-bb09-a09069549af3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:23.208375 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-588a2949-e92f-453b-bb09-a09069549af3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:23.219907 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [req-686412a7-f2f0-4209-9e51-77510dc8b476 req-1d7243a9-ea63-4cd8-a754-ffd0ea167675 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d5ad250-b1c3-4849-9018-b9814f65927c", "tag": "1ca6d999-b984-4833-8b8f-a6e9c0526e9e"}]} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:23.221899 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:30:23.221899 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: warnings.warn(msg) Apr 30 13:30:23.230825 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-588a2949-e92f-453b-bb09-a09069549af3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:23.231294 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-588a2949-e92f-453b-bb09-a09069549af3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:23.232363 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-588a2949-e92f-453b-bb09-a09069549af3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:23.232811 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-588a2949-e92f-453b-bb09-a09069549af3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:23.240417 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-686412a7-f2f0-4209-9e51-77510dc8b476 req-1d7243a9-ea63-4cd8-a754-ffd0ea167675 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:23.241547 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-686412a7-f2f0-4209-9e51-77510dc8b476 req-1d7243a9-ea63-4cd8-a754-ffd0ea167675 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:23.261680 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.compute.server_external_events [req-686412a7-f2f0-4209-9e51-77510dc8b476 req-1d7243a9-ea63-4cd8-a754-ffd0ea167675 service nova] Creating event network-changed:1ca6d999-b984-4833-8b8f-a6e9c0526e9e for instance 9d5ad250-b1c3-4849-9018-b9814f65927c on hv-cinder-78836 Apr 30 13:30:23.267760 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [req-686412a7-f2f0-4209-9e51-77510dc8b476 req-1d7243a9-ea63-4cd8-a754-ffd0ea167675 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060201 Apr 30 13:30:23.268774 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 730/1568] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:30:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:30:23.303678 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-588a2949-e92f-453b-bb09-a09069549af3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Going to try to terminate instance {{(pid=87933) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 13:30:23.520591 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-c9441eda-daf1-4f83-97fa-d97cd8430e0b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:23.521765 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-c9441eda-daf1-4f83-97fa-d97cd8430e0b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:23.521893 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-588a2949-e92f-453b-bb09-a09069549af3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 204 len: 0 microversion: 2.1 time: 0.320135 Apr 30 13:30:23.525916 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 839/1569] 10.222.0.79 () {58 vars in 1239 bytes} [Fri Apr 30 13:30:23 2021] DELETE /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 13:30:23.532053 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-e8e8978d-936e-40c7-a87c-8ec69320b084 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:23.533401 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-e8e8978d-936e-40c7-a87c-8ec69320b084 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:23.538798 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c9441eda-daf1-4f83-97fa-d97cd8430e0b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:23.540259 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c9441eda-daf1-4f83-97fa-d97cd8430e0b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:23.548397 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c9441eda-daf1-4f83-97fa-d97cd8430e0b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:23.550316 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c9441eda-daf1-4f83-97fa-d97cd8430e0b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:23.556080 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e8e8978d-936e-40c7-a87c-8ec69320b084 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:23.556080 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e8e8978d-936e-40c7-a87c-8ec69320b084 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:23.556420 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e8e8978d-936e-40c7-a87c-8ec69320b084 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:23.556639 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e8e8978d-936e-40c7-a87c-8ec69320b084 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:23.705401 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-c9441eda-daf1-4f83-97fa-d97cd8430e0b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action" status: 200 len: 27437 microversion: 2.20 time: 0.199189 Apr 30 13:30:23.706713 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 731/1570] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:30:23 2021] POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action => generated 27437 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 30 13:30:23.862235 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-e8e8978d-936e-40c7-a87c-8ec69320b084 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:23.872077 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-e8e8978d-936e-40c7-a87c-8ec69320b084 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1568 microversion: 2.1 time: 0.344553 Apr 30 13:30:23.881195 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 840/1571] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:30:23 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1568 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:30:24.721073 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-c7498306-dca7-49fa-a950-fdf0ead3b861 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:24.722830 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-c7498306-dca7-49fa-a950-fdf0ead3b861 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:24.731360 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c7498306-dca7-49fa-a950-fdf0ead3b861 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:24.732105 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c7498306-dca7-49fa-a950-fdf0ead3b861 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:24.733188 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c7498306-dca7-49fa-a950-fdf0ead3b861 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:24.733524 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c7498306-dca7-49fa-a950-fdf0ead3b861 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:24.873088 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-c7498306-dca7-49fa-a950-fdf0ead3b861 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action" status: 200 len: 27991 microversion: 2.20 time: 0.157324 Apr 30 13:30:24.874572 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 732/1572] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:30:24 2021] POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action => generated 27991 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:30:24.890806 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-4d1a1fe7-68fd-4b89-b602-7a4bfa281f4e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:24.891724 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-4d1a1fe7-68fd-4b89-b602-7a4bfa281f4e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:24.899835 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4d1a1fe7-68fd-4b89-b602-7a4bfa281f4e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:24.900296 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4d1a1fe7-68fd-4b89-b602-7a4bfa281f4e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:24.901096 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4d1a1fe7-68fd-4b89-b602-7a4bfa281f4e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:24.901534 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4d1a1fe7-68fd-4b89-b602-7a4bfa281f4e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:25.025596 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-4d1a1fe7-68fd-4b89-b602-7a4bfa281f4e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:25.035327 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-4d1a1fe7-68fd-4b89-b602-7a4bfa281f4e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1382 microversion: 2.1 time: 0.148079 Apr 30 13:30:25.036182 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 841/1573] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:30:24 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1382 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:30:25.113151 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [req-1d5d8ff1-c501-4f2b-9f02-5d99cf4e5533 req-5167776d-3fff-49f0-9018-e3bc438bd29e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d5ad250-b1c3-4849-9018-b9814f65927c", "name": "network-vif-deleted", "tag": "1ca6d999-b984-4833-8b8f-a6e9c0526e9e"}]} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:25.114914 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:30:25.114914 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: warnings.warn(msg) Apr 30 13:30:25.123941 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-1d5d8ff1-c501-4f2b-9f02-5d99cf4e5533 req-5167776d-3fff-49f0-9018-e3bc438bd29e service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:25.124390 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-1d5d8ff1-c501-4f2b-9f02-5d99cf4e5533 req-5167776d-3fff-49f0-9018-e3bc438bd29e service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:25.141672 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.compute.server_external_events [req-1d5d8ff1-c501-4f2b-9f02-5d99cf4e5533 req-5167776d-3fff-49f0-9018-e3bc438bd29e service nova] Creating event network-vif-deleted:1ca6d999-b984-4833-8b8f-a6e9c0526e9e for instance 9d5ad250-b1c3-4849-9018-b9814f65927c on hv-cinder-78836 Apr 30 13:30:25.146491 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [req-1d5d8ff1-c501-4f2b-9f02-5d99cf4e5533 req-5167776d-3fff-49f0-9018-e3bc438bd29e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037612 Apr 30 13:30:25.147530 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 733/1574] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:30:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:30:25.885179 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-0c3779e0-5ff9-4d0a-a5d4-e7ac2ee8f846 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:25.886148 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-0c3779e0-5ff9-4d0a-a5d4-e7ac2ee8f846 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:25.893594 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0c3779e0-5ff9-4d0a-a5d4-e7ac2ee8f846 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:25.894203 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0c3779e0-5ff9-4d0a-a5d4-e7ac2ee8f846 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:25.894859 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0c3779e0-5ff9-4d0a-a5d4-e7ac2ee8f846 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:25.895304 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0c3779e0-5ff9-4d0a-a5d4-e7ac2ee8f846 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:26.024487 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-0c3779e0-5ff9-4d0a-a5d4-e7ac2ee8f846 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action" status: 200 len: 28227 microversion: 2.20 time: 0.142804 Apr 30 13:30:26.025165 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 842/1575] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:30:25 2021] POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action => generated 28227 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:30:26.053622 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-971bf1d0-fd48-425d-8082-a1037bd240c7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:26.054364 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-971bf1d0-fd48-425d-8082-a1037bd240c7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:26.061936 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-971bf1d0-fd48-425d-8082-a1037bd240c7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:26.062425 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-971bf1d0-fd48-425d-8082-a1037bd240c7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:26.063829 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-971bf1d0-fd48-425d-8082-a1037bd240c7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:26.064273 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-971bf1d0-fd48-425d-8082-a1037bd240c7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:26.196623 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-971bf1d0-fd48-425d-8082-a1037bd240c7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:26.205051 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-971bf1d0-fd48-425d-8082-a1037bd240c7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.155569 Apr 30 13:30:26.205617 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 734/1576] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:30:26 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:30:27.037721 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-5e790976-29c8-4dae-b8fa-ab67a5363898 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:27.038776 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-5e790976-29c8-4dae-b8fa-ab67a5363898 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:27.047875 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5e790976-29c8-4dae-b8fa-ab67a5363898 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:27.048204 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5e790976-29c8-4dae-b8fa-ab67a5363898 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:27.049056 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5e790976-29c8-4dae-b8fa-ab67a5363898 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:27.049503 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5e790976-29c8-4dae-b8fa-ab67a5363898 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:27.176313 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-5e790976-29c8-4dae-b8fa-ab67a5363898 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action" status: 200 len: 28227 microversion: 2.20 time: 0.142877 Apr 30 13:30:27.176965 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 843/1577] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:30:27 2021] POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action => generated 28227 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:30:27.221019 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-79fbcc3f-e44c-4e31-8e4b-fdee919068c5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:27.221637 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-79fbcc3f-e44c-4e31-8e4b-fdee919068c5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:27.229038 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-79fbcc3f-e44c-4e31-8e4b-fdee919068c5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:27.229494 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-79fbcc3f-e44c-4e31-8e4b-fdee919068c5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:27.230296 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-79fbcc3f-e44c-4e31-8e4b-fdee919068c5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:27.230739 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-79fbcc3f-e44c-4e31-8e4b-fdee919068c5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:27.342906 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-79fbcc3f-e44c-4e31-8e4b-fdee919068c5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:27.351370 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-79fbcc3f-e44c-4e31-8e4b-fdee919068c5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.134171 Apr 30 13:30:27.351940 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 735/1578] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:30:27 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:30:27.413397 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:30:27.413627 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: Fri Apr 30 13:30:27 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:30:28.188544 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b4f9f749-4017-4745-b6e9-2f92733d0ee3 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:28.189657 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-b4f9f749-4017-4745-b6e9-2f92733d0ee3 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:28.197595 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b4f9f749-4017-4745-b6e9-2f92733d0ee3 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:28.198078 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b4f9f749-4017-4745-b6e9-2f92733d0ee3 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:28.198917 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b4f9f749-4017-4745-b6e9-2f92733d0ee3 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:28.199362 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b4f9f749-4017-4745-b6e9-2f92733d0ee3 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:28.330954 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b4f9f749-4017-4745-b6e9-2f92733d0ee3 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action" status: 200 len: 28518 microversion: 2.20 time: 0.146551 Apr 30 13:30:28.331606 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 844/1579] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:30:28 2021] POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action => generated 28518 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:30:28.530193 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-ad49c59f-949e-4c22-8dc3-cde20f183447 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:28.530811 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-ad49c59f-949e-4c22-8dc3-cde20f183447 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:28.539200 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ad49c59f-949e-4c22-8dc3-cde20f183447 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:28.539648 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ad49c59f-949e-4c22-8dc3-cde20f183447 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:28.540427 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ad49c59f-949e-4c22-8dc3-cde20f183447 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:28.540860 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ad49c59f-949e-4c22-8dc3-cde20f183447 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:28.655028 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-ad49c59f-949e-4c22-8dc3-cde20f183447 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:28.664207 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-ad49c59f-949e-4c22-8dc3-cde20f183447 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.299430 Apr 30 13:30:28.664776 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 736/1580] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:30:28 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:30:29.343242 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-633283bc-3985-4ef3-b148-55a44614f6d4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:29.344379 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-633283bc-3985-4ef3-b148-55a44614f6d4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:29.352408 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-633283bc-3985-4ef3-b148-55a44614f6d4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:29.352859 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-633283bc-3985-4ef3-b148-55a44614f6d4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:29.353637 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-633283bc-3985-4ef3-b148-55a44614f6d4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:29.354163 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-633283bc-3985-4ef3-b148-55a44614f6d4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:29.487337 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-633283bc-3985-4ef3-b148-55a44614f6d4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action" status: 200 len: 28686 microversion: 2.20 time: 0.147974 Apr 30 13:30:29.487899 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 845/1581] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:30:29 2021] POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action => generated 28686 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:30:29.681824 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-97431c5f-380a-48c1-88b1-01f7993dca5a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:29.682464 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-97431c5f-380a-48c1-88b1-01f7993dca5a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:29.691745 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-97431c5f-380a-48c1-88b1-01f7993dca5a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:29.692199 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-97431c5f-380a-48c1-88b1-01f7993dca5a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:29.692997 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-97431c5f-380a-48c1-88b1-01f7993dca5a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:29.693445 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-97431c5f-380a-48c1-88b1-01f7993dca5a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:29.807886 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-97431c5f-380a-48c1-88b1-01f7993dca5a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:29.816733 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-97431c5f-380a-48c1-88b1-01f7993dca5a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.138716 Apr 30 13:30:29.817294 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 737/1582] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:30:29 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:30:30.499790 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-0e9ed2b2-e901-4bac-928e-37acf547cd1d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:30.500867 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-0e9ed2b2-e901-4bac-928e-37acf547cd1d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:30.509179 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0e9ed2b2-e901-4bac-928e-37acf547cd1d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:30.509629 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0e9ed2b2-e901-4bac-928e-37acf547cd1d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:30.510456 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0e9ed2b2-e901-4bac-928e-37acf547cd1d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:30.510893 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0e9ed2b2-e901-4bac-928e-37acf547cd1d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:30.632655 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-0e9ed2b2-e901-4bac-928e-37acf547cd1d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action" status: 200 len: 28686 microversion: 2.20 time: 0.136667 Apr 30 13:30:30.633204 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 846/1583] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:30:30 2021] POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action => generated 28686 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 30 13:30:30.834025 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-1c4538e2-36bd-49fe-bfe6-44b4d68bd413 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:30.834849 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-1c4538e2-36bd-49fe-bfe6-44b4d68bd413 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:30.843524 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1c4538e2-36bd-49fe-bfe6-44b4d68bd413 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:30.844603 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1c4538e2-36bd-49fe-bfe6-44b4d68bd413 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:30.845449 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1c4538e2-36bd-49fe-bfe6-44b4d68bd413 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:30.845901 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1c4538e2-36bd-49fe-bfe6-44b4d68bd413 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:30.960480 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-1c4538e2-36bd-49fe-bfe6-44b4d68bd413 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:30.969585 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-1c4538e2-36bd-49fe-bfe6-44b4d68bd413 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.138842 Apr 30 13:30:30.970181 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 738/1584] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:30:30 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:30:31.645219 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b772cd0e-5b64-4a61-9856-87fb5c75772c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:31.646163 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-b772cd0e-5b64-4a61-9856-87fb5c75772c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:31.654162 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b772cd0e-5b64-4a61-9856-87fb5c75772c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:31.654621 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b772cd0e-5b64-4a61-9856-87fb5c75772c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:31.655394 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b772cd0e-5b64-4a61-9856-87fb5c75772c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:31.655826 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b772cd0e-5b64-4a61-9856-87fb5c75772c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:31.782446 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b772cd0e-5b64-4a61-9856-87fb5c75772c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action" status: 200 len: 28686 microversion: 2.20 time: 0.141517 Apr 30 13:30:31.783442 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 847/1585] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:30:31 2021] POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action => generated 28686 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:30:31.987114 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-e628d494-0abd-44bb-bd72-7a9446c02346 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:31.987738 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-e628d494-0abd-44bb-bd72-7a9446c02346 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:31.995110 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e628d494-0abd-44bb-bd72-7a9446c02346 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:31.995566 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e628d494-0abd-44bb-bd72-7a9446c02346 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:31.996358 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e628d494-0abd-44bb-bd72-7a9446c02346 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:31.996797 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e628d494-0abd-44bb-bd72-7a9446c02346 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:32.112862 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-e628d494-0abd-44bb-bd72-7a9446c02346 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:32.121675 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-e628d494-0abd-44bb-bd72-7a9446c02346 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.138976 Apr 30 13:30:32.122282 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 739/1586] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:30:31 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:30:32.796016 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-4f70fbde-c6d2-49dd-8f22-cd2ac566d6a8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:32.797049 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-4f70fbde-c6d2-49dd-8f22-cd2ac566d6a8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:32.805346 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4f70fbde-c6d2-49dd-8f22-cd2ac566d6a8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:32.805807 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4f70fbde-c6d2-49dd-8f22-cd2ac566d6a8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:32.806627 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4f70fbde-c6d2-49dd-8f22-cd2ac566d6a8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:32.807076 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4f70fbde-c6d2-49dd-8f22-cd2ac566d6a8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:32.940817 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-4f70fbde-c6d2-49dd-8f22-cd2ac566d6a8 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action" status: 200 len: 29986 microversion: 2.20 time: 0.148941 Apr 30 13:30:32.941697 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 848/1587] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:30:32 2021] POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action => generated 29986 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 30 13:30:33.138988 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-ae0063a1-a0c6-490f-afa3-aee9c54c810f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:33.139562 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-ae0063a1-a0c6-490f-afa3-aee9c54c810f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:33.147925 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ae0063a1-a0c6-490f-afa3-aee9c54c810f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:33.148372 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ae0063a1-a0c6-490f-afa3-aee9c54c810f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:33.149150 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ae0063a1-a0c6-490f-afa3-aee9c54c810f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:33.149593 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ae0063a1-a0c6-490f-afa3-aee9c54c810f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:33.265217 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-ae0063a1-a0c6-490f-afa3-aee9c54c810f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:33.273668 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-ae0063a1-a0c6-490f-afa3-aee9c54c810f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.138444 Apr 30 13:30:33.274259 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 740/1588] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:30:33 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:30:33.953294 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-fa125050-c7d7-47e4-b47d-0928e27e5e6d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:33.954585 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-fa125050-c7d7-47e4-b47d-0928e27e5e6d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:33.962567 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-fa125050-c7d7-47e4-b47d-0928e27e5e6d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:33.963016 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-fa125050-c7d7-47e4-b47d-0928e27e5e6d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:33.963800 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-fa125050-c7d7-47e4-b47d-0928e27e5e6d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:33.964233 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-fa125050-c7d7-47e4-b47d-0928e27e5e6d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:34.101550 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-fa125050-c7d7-47e4-b47d-0928e27e5e6d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action" status: 200 len: 32261 microversion: 2.20 time: 0.152260 Apr 30 13:30:34.102197 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 849/1589] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:30:33 2021] POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action => generated 32261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:30:34.291652 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-5371df97-532c-4809-893a-64565b2df9ab tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:34.292303 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-5371df97-532c-4809-893a-64565b2df9ab tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:34.300136 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5371df97-532c-4809-893a-64565b2df9ab tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:34.300596 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5371df97-532c-4809-893a-64565b2df9ab tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:34.301382 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5371df97-532c-4809-893a-64565b2df9ab tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:34.301821 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5371df97-532c-4809-893a-64565b2df9ab tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:34.420964 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-5371df97-532c-4809-893a-64565b2df9ab tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:34.429413 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-5371df97-532c-4809-893a-64565b2df9ab tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.141766 Apr 30 13:30:34.429989 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 741/1590] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:30:34 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:30:35.114619 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-fd6479ef-219f-4068-8199-228c0932c695 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:35.115661 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-fd6479ef-219f-4068-8199-228c0932c695 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:35.124429 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-fd6479ef-219f-4068-8199-228c0932c695 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:35.124804 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-fd6479ef-219f-4068-8199-228c0932c695 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:35.125733 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-fd6479ef-219f-4068-8199-228c0932c695 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:35.126304 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-fd6479ef-219f-4068-8199-228c0932c695 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:35.271669 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-fd6479ef-219f-4068-8199-228c0932c695 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action" status: 200 len: 33557 microversion: 2.20 time: 0.161780 Apr 30 13:30:35.272604 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 850/1591] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:30:35 2021] POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action => generated 33557 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:30:35.447896 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-0664964d-d7ca-456b-a4e3-b0d9db26b58f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:35.448634 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-0664964d-d7ca-456b-a4e3-b0d9db26b58f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:35.457712 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0664964d-d7ca-456b-a4e3-b0d9db26b58f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:35.458289 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0664964d-d7ca-456b-a4e3-b0d9db26b58f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:35.459102 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0664964d-d7ca-456b-a4e3-b0d9db26b58f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:35.459556 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0664964d-d7ca-456b-a4e3-b0d9db26b58f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:35.596048 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-0664964d-d7ca-456b-a4e3-b0d9db26b58f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:35.605009 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-0664964d-d7ca-456b-a4e3-b0d9db26b58f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.161273 Apr 30 13:30:35.605586 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 742/1592] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:30:35 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:30:36.285441 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-c483f0cb-4caf-4b83-982f-1877187af439 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:36.286762 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-c483f0cb-4caf-4b83-982f-1877187af439 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:36.294831 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c483f0cb-4caf-4b83-982f-1877187af439 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:36.295288 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c483f0cb-4caf-4b83-982f-1877187af439 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:36.296075 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c483f0cb-4caf-4b83-982f-1877187af439 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:36.296522 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c483f0cb-4caf-4b83-982f-1877187af439 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:36.418883 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-c483f0cb-4caf-4b83-982f-1877187af439 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action" status: 200 len: 34737 microversion: 2.20 time: 0.138319 Apr 30 13:30:36.419567 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 851/1593] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:30:36 2021] POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action => generated 34737 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 30 13:30:36.623845 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-5b11dfdd-8733-4fce-8841-0bd60d4bba64 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:36.624392 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-5b11dfdd-8733-4fce-8841-0bd60d4bba64 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:36.634324 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5b11dfdd-8733-4fce-8841-0bd60d4bba64 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:36.634783 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5b11dfdd-8733-4fce-8841-0bd60d4bba64 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:36.635552 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5b11dfdd-8733-4fce-8841-0bd60d4bba64 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:36.635988 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5b11dfdd-8733-4fce-8841-0bd60d4bba64 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:36.755199 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-5b11dfdd-8733-4fce-8841-0bd60d4bba64 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:36.768359 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-5b11dfdd-8733-4fce-8841-0bd60d4bba64 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.148206 Apr 30 13:30:36.769214 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 743/1594] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:30:36 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:30:37.432087 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-e4d48e59-8e24-4756-ae92-c13de127aac4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:37.433104 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-e4d48e59-8e24-4756-ae92-c13de127aac4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:37.441816 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e4d48e59-8e24-4756-ae92-c13de127aac4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:37.442297 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e4d48e59-8e24-4756-ae92-c13de127aac4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:37.443087 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e4d48e59-8e24-4756-ae92-c13de127aac4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:37.443534 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e4d48e59-8e24-4756-ae92-c13de127aac4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:37.581165 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-e4d48e59-8e24-4756-ae92-c13de127aac4 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action" status: 200 len: 36127 microversion: 2.20 time: 0.153216 Apr 30 13:30:37.582122 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 852/1595] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:30:37 2021] POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action => generated 36127 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:30:37.785321 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-1a26a7f4-7b2e-4b52-b933-fed60ca6d0dd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:37.786143 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-1a26a7f4-7b2e-4b52-b933-fed60ca6d0dd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:37.793587 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1a26a7f4-7b2e-4b52-b933-fed60ca6d0dd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:37.794068 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1a26a7f4-7b2e-4b52-b933-fed60ca6d0dd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:37.794854 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1a26a7f4-7b2e-4b52-b933-fed60ca6d0dd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:37.795349 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1a26a7f4-7b2e-4b52-b933-fed60ca6d0dd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:37.917222 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-1a26a7f4-7b2e-4b52-b933-fed60ca6d0dd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:37.927072 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-1a26a7f4-7b2e-4b52-b933-fed60ca6d0dd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.145748 Apr 30 13:30:37.927659 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 744/1596] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:30:37 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:30:38.596289 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-55dde228-854b-42e9-b2a7-d6d60d43222e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:38.597372 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-55dde228-854b-42e9-b2a7-d6d60d43222e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:38.606716 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-55dde228-854b-42e9-b2a7-d6d60d43222e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:38.607307 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-55dde228-854b-42e9-b2a7-d6d60d43222e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:38.608000 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-55dde228-854b-42e9-b2a7-d6d60d43222e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:38.608455 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-55dde228-854b-42e9-b2a7-d6d60d43222e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:38.745806 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-55dde228-854b-42e9-b2a7-d6d60d43222e tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action" status: 200 len: 37902 microversion: 2.20 time: 0.155407 Apr 30 13:30:38.746532 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 853/1597] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:30:38 2021] POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action => generated 37902 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:30:38.951601 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-5f45966f-b306-45bc-bda6-6d42b668c0bf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:38.952336 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-5f45966f-b306-45bc-bda6-6d42b668c0bf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:38.960028 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5f45966f-b306-45bc-bda6-6d42b668c0bf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:38.960633 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5f45966f-b306-45bc-bda6-6d42b668c0bf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:38.961518 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5f45966f-b306-45bc-bda6-6d42b668c0bf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:38.961970 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5f45966f-b306-45bc-bda6-6d42b668c0bf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:39.086794 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-5f45966f-b306-45bc-bda6-6d42b668c0bf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:39.101102 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-5f45966f-b306-45bc-bda6-6d42b668c0bf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.158599 Apr 30 13:30:39.101845 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 745/1598] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:30:38 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:30:39.759163 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-107867fa-9708-46b1-8a04-aa23a4a9693a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:39.760166 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-107867fa-9708-46b1-8a04-aa23a4a9693a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:39.773414 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-107867fa-9708-46b1-8a04-aa23a4a9693a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:39.773872 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-107867fa-9708-46b1-8a04-aa23a4a9693a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:39.774699 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-107867fa-9708-46b1-8a04-aa23a4a9693a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:39.775143 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-107867fa-9708-46b1-8a04-aa23a4a9693a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:39.963701 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-107867fa-9708-46b1-8a04-aa23a4a9693a tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action" status: 200 len: 38241 microversion: 2.20 time: 0.208509 Apr 30 13:30:39.964353 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 854/1599] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:30:39 2021] POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action => generated 38241 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:30:40.119454 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-8ea0ff96-c195-4518-a24b-224a6972c065 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:40.120060 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-8ea0ff96-c195-4518-a24b-224a6972c065 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:40.128132 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8ea0ff96-c195-4518-a24b-224a6972c065 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:40.128583 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8ea0ff96-c195-4518-a24b-224a6972c065 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:40.129361 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8ea0ff96-c195-4518-a24b-224a6972c065 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:40.129799 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8ea0ff96-c195-4518-a24b-224a6972c065 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:40.255002 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-8ea0ff96-c195-4518-a24b-224a6972c065 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:40.265027 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-8ea0ff96-c195-4518-a24b-224a6972c065 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.148969 Apr 30 13:30:40.266498 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 746/1600] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:30:40 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:30:40.976787 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-3bfd65a1-2f51-465f-9778-6e1b03b029df tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:40.977812 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-3bfd65a1-2f51-465f-9778-6e1b03b029df tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:40.985905 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3bfd65a1-2f51-465f-9778-6e1b03b029df tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:40.986411 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3bfd65a1-2f51-465f-9778-6e1b03b029df tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:40.987181 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3bfd65a1-2f51-465f-9778-6e1b03b029df tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:40.988105 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3bfd65a1-2f51-465f-9778-6e1b03b029df tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:41.108220 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-3bfd65a1-2f51-465f-9778-6e1b03b029df tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action" status: 200 len: 38241 microversion: 2.20 time: 0.135621 Apr 30 13:30:41.109110 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 855/1601] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:30:40 2021] POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action => generated 38241 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 30 13:30:41.283796 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-89891baa-716b-4d01-93ba-8c424a16acd1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:41.284669 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-89891baa-716b-4d01-93ba-8c424a16acd1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:41.292549 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-89891baa-716b-4d01-93ba-8c424a16acd1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:41.293008 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-89891baa-716b-4d01-93ba-8c424a16acd1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:41.293795 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-89891baa-716b-4d01-93ba-8c424a16acd1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:41.294269 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-89891baa-716b-4d01-93ba-8c424a16acd1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:41.441342 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-89891baa-716b-4d01-93ba-8c424a16acd1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:41.450304 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-89891baa-716b-4d01-93ba-8c424a16acd1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.170475 Apr 30 13:30:41.450969 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 747/1602] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:30:41 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:30:42.130640 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-14b67187-f41a-49af-a9f6-be191c9b1e21 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:42.132138 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-14b67187-f41a-49af-a9f6-be191c9b1e21 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:42.142177 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-14b67187-f41a-49af-a9f6-be191c9b1e21 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:42.142744 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-14b67187-f41a-49af-a9f6-be191c9b1e21 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:42.143548 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-14b67187-f41a-49af-a9f6-be191c9b1e21 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:42.144002 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-14b67187-f41a-49af-a9f6-be191c9b1e21 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:42.272930 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-14b67187-f41a-49af-a9f6-be191c9b1e21 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action" status: 200 len: 38241 microversion: 2.20 time: 0.149844 Apr 30 13:30:42.278577 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 856/1603] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:30:42 2021] POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action => generated 38241 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 30 13:30:42.468639 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-208294ef-885c-4045-82b1-7131860a0ae5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:42.470076 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-208294ef-885c-4045-82b1-7131860a0ae5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:42.483046 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-208294ef-885c-4045-82b1-7131860a0ae5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:42.486033 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-208294ef-885c-4045-82b1-7131860a0ae5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:42.486033 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-208294ef-885c-4045-82b1-7131860a0ae5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:42.486033 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-208294ef-885c-4045-82b1-7131860a0ae5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:42.616965 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-208294ef-885c-4045-82b1-7131860a0ae5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:42.626271 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-208294ef-885c-4045-82b1-7131860a0ae5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.161354 Apr 30 13:30:42.627097 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 748/1604] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:30:42 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:30:43.288867 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-68b6ff72-1c95-4562-b66c-572d07140a12 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:30:43.289940 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-68b6ff72-1c95-4562-b66c-572d07140a12 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:43.307777 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-68b6ff72-1c95-4562-b66c-572d07140a12 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:43.308547 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-68b6ff72-1c95-4562-b66c-572d07140a12 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:43.309909 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-68b6ff72-1c95-4562-b66c-572d07140a12 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:43.310697 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-68b6ff72-1c95-4562-b66c-572d07140a12 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:43.482733 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-68b6ff72-1c95-4562-b66c-572d07140a12 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action" status: 200 len: 38382 microversion: 2.20 time: 0.199708 Apr 30 13:30:43.483397 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 857/1605] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Apr 30 13:30:43 2021] POST /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/action => generated 38382 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:30:43.503941 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-782cd2f1-63e3-4ee9-b341-a85c7277ae2b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:43.504548 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-782cd2f1-63e3-4ee9-b341-a85c7277ae2b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:43.514611 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-782cd2f1-63e3-4ee9-b341-a85c7277ae2b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:43.515307 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-782cd2f1-63e3-4ee9-b341-a85c7277ae2b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:43.516131 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-782cd2f1-63e3-4ee9-b341-a85c7277ae2b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:43.516579 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-782cd2f1-63e3-4ee9-b341-a85c7277ae2b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:43.594973 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-782cd2f1-63e3-4ee9-b341-a85c7277ae2b tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/ips" status: 200 len: 151 microversion: 2.20 time: 0.102260 Apr 30 13:30:43.595754 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 749/1606] 10.222.0.79 () {60 vars in 1289 bytes} [Fri Apr 30 13:30:43 2021] GET /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781/ips => generated 151 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 30 13:30:43.644864 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-a006c299-39e8-49c2-b8fd-787c7a0ba70c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:43.645570 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-a006c299-39e8-49c2-b8fd-787c7a0ba70c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:43.653828 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a006c299-39e8-49c2-b8fd-787c7a0ba70c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:43.654321 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a006c299-39e8-49c2-b8fd-787c7a0ba70c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:43.655116 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a006c299-39e8-49c2-b8fd-787c7a0ba70c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:43.655551 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a006c299-39e8-49c2-b8fd-787c7a0ba70c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:43.804775 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-a006c299-39e8-49c2-b8fd-787c7a0ba70c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:43.816466 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-a006c299-39e8-49c2-b8fd-787c7a0ba70c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.176237 Apr 30 13:30:43.817055 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 858/1607] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:30:43 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:30:44.837653 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-e99bd5f0-21a5-46a5-89fa-18991cc114b3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:44.838307 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-e99bd5f0-21a5-46a5-89fa-18991cc114b3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:44.845899 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e99bd5f0-21a5-46a5-89fa-18991cc114b3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:44.846385 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e99bd5f0-21a5-46a5-89fa-18991cc114b3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:44.847167 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e99bd5f0-21a5-46a5-89fa-18991cc114b3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:44.847606 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e99bd5f0-21a5-46a5-89fa-18991cc114b3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:44.959657 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-e99bd5f0-21a5-46a5-89fa-18991cc114b3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:44.967809 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-e99bd5f0-21a5-46a5-89fa-18991cc114b3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.133865 Apr 30 13:30:44.969182 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 750/1608] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:30:44 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:30:45.987429 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-ca345ec9-4ad1-42ef-93a6-88890b64b04c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:45.988249 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-ca345ec9-4ad1-42ef-93a6-88890b64b04c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:45.999479 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ca345ec9-4ad1-42ef-93a6-88890b64b04c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:46.000090 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ca345ec9-4ad1-42ef-93a6-88890b64b04c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:46.000897 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ca345ec9-4ad1-42ef-93a6-88890b64b04c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:46.001343 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ca345ec9-4ad1-42ef-93a6-88890b64b04c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:46.144874 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-ca345ec9-4ad1-42ef-93a6-88890b64b04c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:46.153747 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-ca345ec9-4ad1-42ef-93a6-88890b64b04c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.172832 Apr 30 13:30:46.154333 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 859/1609] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:30:45 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:30:47.172595 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-0f2dfbe6-f930-4cbb-9bda-4e307b2038d0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:47.173290 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-0f2dfbe6-f930-4cbb-9bda-4e307b2038d0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:47.181275 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0f2dfbe6-f930-4cbb-9bda-4e307b2038d0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:47.181887 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0f2dfbe6-f930-4cbb-9bda-4e307b2038d0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:47.182958 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0f2dfbe6-f930-4cbb-9bda-4e307b2038d0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:47.183447 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0f2dfbe6-f930-4cbb-9bda-4e307b2038d0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:47.299948 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-0f2dfbe6-f930-4cbb-9bda-4e307b2038d0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:47.308355 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-0f2dfbe6-f930-4cbb-9bda-4e307b2038d0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.139810 Apr 30 13:30:47.308928 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 751/1610] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:30:47 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:30:48.326967 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-1a03f378-c9c5-43b8-a981-61dd3837fb42 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:48.327575 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-1a03f378-c9c5-43b8-a981-61dd3837fb42 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:48.348698 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1a03f378-c9c5-43b8-a981-61dd3837fb42 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:48.349503 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1a03f378-c9c5-43b8-a981-61dd3837fb42 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:48.351040 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1a03f378-c9c5-43b8-a981-61dd3837fb42 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:48.351746 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1a03f378-c9c5-43b8-a981-61dd3837fb42 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:48.542298 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-1a03f378-c9c5-43b8-a981-61dd3837fb42 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:48.555375 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-1a03f378-c9c5-43b8-a981-61dd3837fb42 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.232170 Apr 30 13:30:48.555974 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 860/1611] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:30:48 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:30:49.576134 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-a521f10a-409b-447e-b380-08631e48febf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:49.576803 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-a521f10a-409b-447e-b380-08631e48febf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:49.586052 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a521f10a-409b-447e-b380-08631e48febf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:49.586500 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a521f10a-409b-447e-b380-08631e48febf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:49.587322 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a521f10a-409b-447e-b380-08631e48febf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:49.587772 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a521f10a-409b-447e-b380-08631e48febf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:49.713549 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-a521f10a-409b-447e-b380-08631e48febf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:49.723150 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-a521f10a-409b-447e-b380-08631e48febf tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.150283 Apr 30 13:30:49.723150 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 752/1612] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:30:49 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:30:50.742545 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-16facb44-ac72-4bb5-9546-433d0332ea9b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:50.743530 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-16facb44-ac72-4bb5-9546-433d0332ea9b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:50.757805 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-16facb44-ac72-4bb5-9546-433d0332ea9b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:50.758502 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-16facb44-ac72-4bb5-9546-433d0332ea9b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:50.759784 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-16facb44-ac72-4bb5-9546-433d0332ea9b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:50.760478 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-16facb44-ac72-4bb5-9546-433d0332ea9b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:50.962600 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-16facb44-ac72-4bb5-9546-433d0332ea9b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:50.979740 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-16facb44-ac72-4bb5-9546-433d0332ea9b tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.243732 Apr 30 13:30:50.980816 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 861/1613] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:30:50 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:30:52.004692 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-5f22f83b-5d93-4a57-a9aa-c1f214701a4e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:52.005344 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-5f22f83b-5d93-4a57-a9aa-c1f214701a4e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:52.012826 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5f22f83b-5d93-4a57-a9aa-c1f214701a4e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:52.013284 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5f22f83b-5d93-4a57-a9aa-c1f214701a4e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:52.014116 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5f22f83b-5d93-4a57-a9aa-c1f214701a4e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:52.014561 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5f22f83b-5d93-4a57-a9aa-c1f214701a4e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:52.130443 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-5f22f83b-5d93-4a57-a9aa-c1f214701a4e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:52.143157 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-5f22f83b-5d93-4a57-a9aa-c1f214701a4e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.142192 Apr 30 13:30:52.143734 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 753/1614] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:30:51 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:30:53.162104 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-17a2153c-2041-4ffa-aafc-9f5de59e2a76 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:53.162729 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-17a2153c-2041-4ffa-aafc-9f5de59e2a76 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:53.170801 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-17a2153c-2041-4ffa-aafc-9f5de59e2a76 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:53.171286 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-17a2153c-2041-4ffa-aafc-9f5de59e2a76 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:53.172064 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-17a2153c-2041-4ffa-aafc-9f5de59e2a76 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:53.172614 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-17a2153c-2041-4ffa-aafc-9f5de59e2a76 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:53.293531 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-17a2153c-2041-4ffa-aafc-9f5de59e2a76 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:53.302418 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-17a2153c-2041-4ffa-aafc-9f5de59e2a76 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.145505 Apr 30 13:30:53.303013 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 862/1615] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:30:53 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:30:54.320499 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-d06000f5-411c-4faf-9ca5-84e6ef40c46f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:54.321433 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-d06000f5-411c-4faf-9ca5-84e6ef40c46f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:54.329348 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d06000f5-411c-4faf-9ca5-84e6ef40c46f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:54.329810 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d06000f5-411c-4faf-9ca5-84e6ef40c46f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:54.330640 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d06000f5-411c-4faf-9ca5-84e6ef40c46f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:54.331267 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d06000f5-411c-4faf-9ca5-84e6ef40c46f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:54.447502 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-d06000f5-411c-4faf-9ca5-84e6ef40c46f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:54.456978 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-d06000f5-411c-4faf-9ca5-84e6ef40c46f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.140172 Apr 30 13:30:54.457641 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 754/1616] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:30:54 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:30:55.474542 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-0c67132c-77dc-4da9-af4b-de1a5937a2c4 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:55.475104 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-0c67132c-77dc-4da9-af4b-de1a5937a2c4 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:55.482796 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0c67132c-77dc-4da9-af4b-de1a5937a2c4 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:55.483241 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0c67132c-77dc-4da9-af4b-de1a5937a2c4 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:55.484934 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0c67132c-77dc-4da9-af4b-de1a5937a2c4 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:55.485522 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0c67132c-77dc-4da9-af4b-de1a5937a2c4 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:55.602536 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-0c67132c-77dc-4da9-af4b-de1a5937a2c4 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:55.611969 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-0c67132c-77dc-4da9-af4b-de1a5937a2c4 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.141206 Apr 30 13:30:55.612540 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 863/1617] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:30:55 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:30:56.629580 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-cbcf789c-e54e-42e5-a0c4-0711218577ef tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:56.630431 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-cbcf789c-e54e-42e5-a0c4-0711218577ef tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:56.637404 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cbcf789c-e54e-42e5-a0c4-0711218577ef tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:56.637911 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cbcf789c-e54e-42e5-a0c4-0711218577ef tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:56.638657 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cbcf789c-e54e-42e5-a0c4-0711218577ef tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:56.639092 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cbcf789c-e54e-42e5-a0c4-0711218577ef tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:56.759145 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-cbcf789c-e54e-42e5-a0c4-0711218577ef tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:56.767745 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-cbcf789c-e54e-42e5-a0c4-0711218577ef tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.142823 Apr 30 13:30:56.768307 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 755/1618] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:30:56 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:30:57.788128 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-acc0eecd-d2d0-4441-bf92-f54da979291a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:57.789245 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-acc0eecd-d2d0-4441-bf92-f54da979291a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:57.802830 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-acc0eecd-d2d0-4441-bf92-f54da979291a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:57.803677 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-acc0eecd-d2d0-4441-bf92-f54da979291a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:57.805182 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-acc0eecd-d2d0-4441-bf92-f54da979291a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:57.806042 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-acc0eecd-d2d0-4441-bf92-f54da979291a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:57.994553 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-acc0eecd-d2d0-4441-bf92-f54da979291a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:58.009214 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-acc0eecd-d2d0-4441-bf92-f54da979291a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.227628 Apr 30 13:30:58.010448 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 864/1619] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:30:57 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:30:59.033870 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-170f00c7-4fd5-4711-930f-a37ad36bdbf3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:30:59.034453 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-170f00c7-4fd5-4711-930f-a37ad36bdbf3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:30:59.043510 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-170f00c7-4fd5-4711-930f-a37ad36bdbf3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:59.044045 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-170f00c7-4fd5-4711-930f-a37ad36bdbf3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:59.045006 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-170f00c7-4fd5-4711-930f-a37ad36bdbf3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:30:59.045523 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-170f00c7-4fd5-4711-930f-a37ad36bdbf3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:30:59.168594 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-170f00c7-4fd5-4711-930f-a37ad36bdbf3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:30:59.178481 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-170f00c7-4fd5-4711-930f-a37ad36bdbf3 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.147909 Apr 30 13:30:59.178481 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 756/1620] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:30:59 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:31:00.196531 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-d8f3d784-f2d5-4968-84c1-12c12a5a72c9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:31:00.197268 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-d8f3d784-f2d5-4968-84c1-12c12a5a72c9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:31:00.212944 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d8f3d784-f2d5-4968-84c1-12c12a5a72c9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:00.213932 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d8f3d784-f2d5-4968-84c1-12c12a5a72c9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:00.220611 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d8f3d784-f2d5-4968-84c1-12c12a5a72c9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:00.221480 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d8f3d784-f2d5-4968-84c1-12c12a5a72c9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:00.418284 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-d8f3d784-f2d5-4968-84c1-12c12a5a72c9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:31:00.439273 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-d8f3d784-f2d5-4968-84c1-12c12a5a72c9 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.246481 Apr 30 13:31:00.440239 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 865/1621] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:31:00 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:31:01.462729 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-4593ac9f-2c96-4b2b-93bf-416cefc3c19c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:31:01.463354 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-4593ac9f-2c96-4b2b-93bf-416cefc3c19c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:31:01.471159 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4593ac9f-2c96-4b2b-93bf-416cefc3c19c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:01.471619 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4593ac9f-2c96-4b2b-93bf-416cefc3c19c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:01.472451 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4593ac9f-2c96-4b2b-93bf-416cefc3c19c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:01.472897 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4593ac9f-2c96-4b2b-93bf-416cefc3c19c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:01.587370 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-4593ac9f-2c96-4b2b-93bf-416cefc3c19c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:31:01.596056 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-4593ac9f-2c96-4b2b-93bf-416cefc3c19c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.137487 Apr 30 13:31:01.596631 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 757/1622] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:31:01 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:31:02.613033 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-acda950c-ec25-47e9-affb-048c403e5b96 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:31:02.613714 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-acda950c-ec25-47e9-affb-048c403e5b96 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:31:02.622058 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-acda950c-ec25-47e9-affb-048c403e5b96 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:02.622500 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-acda950c-ec25-47e9-affb-048c403e5b96 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:02.623308 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-acda950c-ec25-47e9-affb-048c403e5b96 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:02.623777 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-acda950c-ec25-47e9-affb-048c403e5b96 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:02.748828 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-acda950c-ec25-47e9-affb-048c403e5b96 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:31:02.758175 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-acda950c-ec25-47e9-affb-048c403e5b96 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.149032 Apr 30 13:31:02.758905 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 866/1623] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:31:02 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:31:03.776093 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-9e944248-f94f-40f8-984c-a3c94c263e30 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:31:03.776738 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-9e944248-f94f-40f8-984c-a3c94c263e30 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:31:03.787030 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9e944248-f94f-40f8-984c-a3c94c263e30 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:03.787479 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9e944248-f94f-40f8-984c-a3c94c263e30 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:03.788273 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9e944248-f94f-40f8-984c-a3c94c263e30 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:03.788711 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9e944248-f94f-40f8-984c-a3c94c263e30 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:03.935822 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-9e944248-f94f-40f8-984c-a3c94c263e30 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:31:03.948367 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-9e944248-f94f-40f8-984c-a3c94c263e30 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.175881 Apr 30 13:31:03.949189 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 758/1624] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:31:03 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:31:04.966142 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-ca2cb324-cf99-49c3-85e8-7e8f65d1eb4e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:31:04.966764 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-ca2cb324-cf99-49c3-85e8-7e8f65d1eb4e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:31:04.975198 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ca2cb324-cf99-49c3-85e8-7e8f65d1eb4e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:04.975656 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ca2cb324-cf99-49c3-85e8-7e8f65d1eb4e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:04.976451 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ca2cb324-cf99-49c3-85e8-7e8f65d1eb4e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:04.976892 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ca2cb324-cf99-49c3-85e8-7e8f65d1eb4e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:05.108785 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-ca2cb324-cf99-49c3-85e8-7e8f65d1eb4e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:31:05.118099 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-ca2cb324-cf99-49c3-85e8-7e8f65d1eb4e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.155506 Apr 30 13:31:05.118613 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 867/1625] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:31:04 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:31:06.134921 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-3495379b-1820-4bd3-9e81-8273beacb3ca tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:31:06.135495 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-3495379b-1820-4bd3-9e81-8273beacb3ca tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:31:06.143587 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3495379b-1820-4bd3-9e81-8273beacb3ca tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:06.144044 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3495379b-1820-4bd3-9e81-8273beacb3ca tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:06.144831 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3495379b-1820-4bd3-9e81-8273beacb3ca tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:06.145277 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3495379b-1820-4bd3-9e81-8273beacb3ca tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:06.259176 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-3495379b-1820-4bd3-9e81-8273beacb3ca tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:31:06.268375 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-3495379b-1820-4bd3-9e81-8273beacb3ca tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.137216 Apr 30 13:31:06.268940 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 759/1626] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:31:06 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:31:07.284620 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-932ad214-a170-4440-ac6f-04f0424300bb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:31:07.285236 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-932ad214-a170-4440-ac6f-04f0424300bb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:31:07.293026 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-932ad214-a170-4440-ac6f-04f0424300bb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:07.293488 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-932ad214-a170-4440-ac6f-04f0424300bb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:07.294311 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-932ad214-a170-4440-ac6f-04f0424300bb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:07.294755 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-932ad214-a170-4440-ac6f-04f0424300bb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:07.416127 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-932ad214-a170-4440-ac6f-04f0424300bb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:31:07.425171 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-932ad214-a170-4440-ac6f-04f0424300bb tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.144291 Apr 30 13:31:07.425745 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 868/1627] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:31:07 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:31:08.442944 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-fe9c1865-fe33-4e74-bbdd-ab708dbb871e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:31:08.443563 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-fe9c1865-fe33-4e74-bbdd-ab708dbb871e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:31:08.451309 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fe9c1865-fe33-4e74-bbdd-ab708dbb871e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:08.451762 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fe9c1865-fe33-4e74-bbdd-ab708dbb871e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:08.453256 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fe9c1865-fe33-4e74-bbdd-ab708dbb871e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:08.453694 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-fe9c1865-fe33-4e74-bbdd-ab708dbb871e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:08.568755 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-fe9c1865-fe33-4e74-bbdd-ab708dbb871e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:31:08.577706 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-fe9c1865-fe33-4e74-bbdd-ab708dbb871e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.137913 Apr 30 13:31:08.578572 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 760/1628] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:31:08 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:31:09.594834 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-02762f72-8a95-4413-a72e-f2daab50674e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:31:09.595457 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-02762f72-8a95-4413-a72e-f2daab50674e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:31:09.602789 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-02762f72-8a95-4413-a72e-f2daab50674e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:09.603240 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-02762f72-8a95-4413-a72e-f2daab50674e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:09.604011 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-02762f72-8a95-4413-a72e-f2daab50674e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:09.604443 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-02762f72-8a95-4413-a72e-f2daab50674e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:09.719528 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-02762f72-8a95-4413-a72e-f2daab50674e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:31:09.728231 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-02762f72-8a95-4413-a72e-f2daab50674e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.137315 Apr 30 13:31:09.729000 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 869/1629] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:31:09 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:31:10.745826 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-bf517747-5f98-4890-a2ad-8b4da5bf2b16 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:31:10.746502 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-bf517747-5f98-4890-a2ad-8b4da5bf2b16 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:31:10.754390 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-bf517747-5f98-4890-a2ad-8b4da5bf2b16 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:10.754841 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-bf517747-5f98-4890-a2ad-8b4da5bf2b16 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:10.755619 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-bf517747-5f98-4890-a2ad-8b4da5bf2b16 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:10.756059 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-bf517747-5f98-4890-a2ad-8b4da5bf2b16 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:10.878765 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-bf517747-5f98-4890-a2ad-8b4da5bf2b16 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:31:10.887012 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-bf517747-5f98-4890-a2ad-8b4da5bf2b16 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.144860 Apr 30 13:31:10.887571 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 761/1630] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:31:10 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:31:11.903620 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-a5680115-53e4-4dca-8e84-8e3d446784da tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:31:11.904230 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-a5680115-53e4-4dca-8e84-8e3d446784da tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:31:11.913071 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a5680115-53e4-4dca-8e84-8e3d446784da tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:11.913527 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a5680115-53e4-4dca-8e84-8e3d446784da tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:11.914359 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a5680115-53e4-4dca-8e84-8e3d446784da tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:11.914814 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a5680115-53e4-4dca-8e84-8e3d446784da tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:12.029351 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-a5680115-53e4-4dca-8e84-8e3d446784da tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:31:12.038246 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-a5680115-53e4-4dca-8e84-8e3d446784da tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.138298 Apr 30 13:31:12.038820 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 870/1631] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:31:11 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:31:13.055097 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-f767c26d-3107-4706-a14d-10aa85379086 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:31:13.055746 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-f767c26d-3107-4706-a14d-10aa85379086 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:31:13.066849 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f767c26d-3107-4706-a14d-10aa85379086 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:13.066849 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f767c26d-3107-4706-a14d-10aa85379086 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:13.066849 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f767c26d-3107-4706-a14d-10aa85379086 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:13.066849 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f767c26d-3107-4706-a14d-10aa85379086 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:13.179389 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-f767c26d-3107-4706-a14d-10aa85379086 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:31:13.188068 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-f767c26d-3107-4706-a14d-10aa85379086 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.136642 Apr 30 13:31:13.188633 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 762/1632] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:31:13 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:31:14.204515 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-0d9b9747-5e7b-4c55-968d-ba463c3b5040 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:31:14.205339 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-0d9b9747-5e7b-4c55-968d-ba463c3b5040 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:31:14.213172 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0d9b9747-5e7b-4c55-968d-ba463c3b5040 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:14.213705 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0d9b9747-5e7b-4c55-968d-ba463c3b5040 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:14.214624 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0d9b9747-5e7b-4c55-968d-ba463c3b5040 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:14.215161 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-0d9b9747-5e7b-4c55-968d-ba463c3b5040 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:14.336617 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-0d9b9747-5e7b-4c55-968d-ba463c3b5040 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:31:14.345461 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-0d9b9747-5e7b-4c55-968d-ba463c3b5040 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.144741 Apr 30 13:31:14.346042 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 871/1633] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:31:14 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:31:15.362611 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-0cc315a9-ee88-49b5-86d3-6f8cf1859ecc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:31:15.363240 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-0cc315a9-ee88-49b5-86d3-6f8cf1859ecc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:31:15.370582 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0cc315a9-ee88-49b5-86d3-6f8cf1859ecc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:15.371044 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0cc315a9-ee88-49b5-86d3-6f8cf1859ecc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:15.371835 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0cc315a9-ee88-49b5-86d3-6f8cf1859ecc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:15.372283 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0cc315a9-ee88-49b5-86d3-6f8cf1859ecc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:15.485285 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-0cc315a9-ee88-49b5-86d3-6f8cf1859ecc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:31:15.493735 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-0cc315a9-ee88-49b5-86d3-6f8cf1859ecc tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.135414 Apr 30 13:31:15.494357 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 763/1634] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:31:15 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:31:16.512589 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-656ffa50-8d39-4c27-bd13-aa59fc4906de tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:31:16.513206 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-656ffa50-8d39-4c27-bd13-aa59fc4906de tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:31:16.520742 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-656ffa50-8d39-4c27-bd13-aa59fc4906de tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:16.521197 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-656ffa50-8d39-4c27-bd13-aa59fc4906de tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:16.521991 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-656ffa50-8d39-4c27-bd13-aa59fc4906de tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:16.522451 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-656ffa50-8d39-4c27-bd13-aa59fc4906de tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:16.635899 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-656ffa50-8d39-4c27-bd13-aa59fc4906de tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:31:16.644273 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-656ffa50-8d39-4c27-bd13-aa59fc4906de tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.135504 Apr 30 13:31:16.644836 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 872/1635] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:31:16 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:31:17.661200 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-7624aeef-d64e-4d2f-aab5-146015d9dbef tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:31:17.661770 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-7624aeef-d64e-4d2f-aab5-146015d9dbef tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:31:17.669287 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7624aeef-d64e-4d2f-aab5-146015d9dbef tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:17.669736 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7624aeef-d64e-4d2f-aab5-146015d9dbef tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:17.671155 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7624aeef-d64e-4d2f-aab5-146015d9dbef tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:17.671704 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7624aeef-d64e-4d2f-aab5-146015d9dbef tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:17.792436 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-7624aeef-d64e-4d2f-aab5-146015d9dbef tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:31:17.801796 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-7624aeef-d64e-4d2f-aab5-146015d9dbef tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.144755 Apr 30 13:31:17.802392 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 764/1636] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:31:17 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:31:18.819092 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b13a54fe-2474-4339-bd81-e6ab7344ae1a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:31:18.819648 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-b13a54fe-2474-4339-bd81-e6ab7344ae1a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:31:18.827493 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b13a54fe-2474-4339-bd81-e6ab7344ae1a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:18.828000 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b13a54fe-2474-4339-bd81-e6ab7344ae1a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:18.828778 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b13a54fe-2474-4339-bd81-e6ab7344ae1a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:18.829218 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b13a54fe-2474-4339-bd81-e6ab7344ae1a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:18.942160 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-b13a54fe-2474-4339-bd81-e6ab7344ae1a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:31:18.950505 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b13a54fe-2474-4339-bd81-e6ab7344ae1a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.135380 Apr 30 13:31:18.951077 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 873/1637] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:31:18 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:31:19.968381 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-2dcf6a62-0a6c-4731-9f38-bfee877eafda tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:31:19.969009 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-2dcf6a62-0a6c-4731-9f38-bfee877eafda tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:31:19.976718 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2dcf6a62-0a6c-4731-9f38-bfee877eafda tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:19.977165 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2dcf6a62-0a6c-4731-9f38-bfee877eafda tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:19.977956 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2dcf6a62-0a6c-4731-9f38-bfee877eafda tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:19.978418 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2dcf6a62-0a6c-4731-9f38-bfee877eafda tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:20.096514 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-2dcf6a62-0a6c-4731-9f38-bfee877eafda tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:31:20.105127 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-2dcf6a62-0a6c-4731-9f38-bfee877eafda tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.141341 Apr 30 13:31:20.105700 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 765/1638] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:31:19 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:31:21.121923 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-6d467c30-0f51-4547-a3a7-7c4399996202 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:31:21.122485 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-6d467c30-0f51-4547-a3a7-7c4399996202 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:31:21.129980 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6d467c30-0f51-4547-a3a7-7c4399996202 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:21.130478 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6d467c30-0f51-4547-a3a7-7c4399996202 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:21.131239 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6d467c30-0f51-4547-a3a7-7c4399996202 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:21.131682 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6d467c30-0f51-4547-a3a7-7c4399996202 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:21.337175 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-6d467c30-0f51-4547-a3a7-7c4399996202 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:31:21.346420 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-6d467c30-0f51-4547-a3a7-7c4399996202 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.228200 Apr 30 13:31:21.346992 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 874/1639] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:31:21 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:31:22.363389 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-1426b4a6-cbc6-4e98-9089-31ee740c5b46 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:31:22.364007 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-1426b4a6-cbc6-4e98-9089-31ee740c5b46 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:31:22.371608 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1426b4a6-cbc6-4e98-9089-31ee740c5b46 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:22.372064 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1426b4a6-cbc6-4e98-9089-31ee740c5b46 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:22.372856 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1426b4a6-cbc6-4e98-9089-31ee740c5b46 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:22.373314 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1426b4a6-cbc6-4e98-9089-31ee740c5b46 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:22.488946 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-1426b4a6-cbc6-4e98-9089-31ee740c5b46 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:31:22.497541 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-1426b4a6-cbc6-4e98-9089-31ee740c5b46 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.137947 Apr 30 13:31:22.498151 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 766/1640] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:31:22 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:31:23.515479 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-49ab0ad6-097e-431b-be62-8c8a6a582cc7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:31:23.516126 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-49ab0ad6-097e-431b-be62-8c8a6a582cc7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:31:23.523666 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-49ab0ad6-097e-431b-be62-8c8a6a582cc7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:23.524122 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-49ab0ad6-097e-431b-be62-8c8a6a582cc7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:23.524916 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-49ab0ad6-097e-431b-be62-8c8a6a582cc7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:23.525355 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-49ab0ad6-097e-431b-be62-8c8a6a582cc7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:23.644635 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-49ab0ad6-097e-431b-be62-8c8a6a582cc7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:31:23.653052 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-49ab0ad6-097e-431b-be62-8c8a6a582cc7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.141859 Apr 30 13:31:23.653622 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 875/1641] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:31:23 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:31:24.670433 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-db4ec2f1-b1a2-47fd-a7c3-2cc18fd1d6f2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:31:24.671069 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-db4ec2f1-b1a2-47fd-a7c3-2cc18fd1d6f2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:31:24.678711 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-db4ec2f1-b1a2-47fd-a7c3-2cc18fd1d6f2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:24.679168 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-db4ec2f1-b1a2-47fd-a7c3-2cc18fd1d6f2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:24.679964 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-db4ec2f1-b1a2-47fd-a7c3-2cc18fd1d6f2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:24.680419 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-db4ec2f1-b1a2-47fd-a7c3-2cc18fd1d6f2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:24.805265 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-db4ec2f1-b1a2-47fd-a7c3-2cc18fd1d6f2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:31:24.816441 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-db4ec2f1-b1a2-47fd-a7c3-2cc18fd1d6f2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.149920 Apr 30 13:31:24.817653 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 767/1642] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:31:24 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:31:25.834862 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-c7ae5f37-c7f0-4163-a2b9-91db2332ea9f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:31:25.835750 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-c7ae5f37-c7f0-4163-a2b9-91db2332ea9f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:31:25.842967 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c7ae5f37-c7f0-4163-a2b9-91db2332ea9f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:25.844076 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c7ae5f37-c7f0-4163-a2b9-91db2332ea9f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:25.845095 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c7ae5f37-c7f0-4163-a2b9-91db2332ea9f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:25.845533 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c7ae5f37-c7f0-4163-a2b9-91db2332ea9f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:25.969171 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-c7ae5f37-c7f0-4163-a2b9-91db2332ea9f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:31:25.977665 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-c7ae5f37-c7f0-4163-a2b9-91db2332ea9f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.146685 Apr 30 13:31:25.978273 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 876/1643] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:31:25 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:31:26.993457 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-4e1734c6-f1af-43d1-96eb-6e2984e54767 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:31:26.994100 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-4e1734c6-f1af-43d1-96eb-6e2984e54767 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:31:27.002649 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4e1734c6-f1af-43d1-96eb-6e2984e54767 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:27.003098 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4e1734c6-f1af-43d1-96eb-6e2984e54767 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:27.003883 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4e1734c6-f1af-43d1-96eb-6e2984e54767 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:27.004321 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4e1734c6-f1af-43d1-96eb-6e2984e54767 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:27.118579 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-4e1734c6-f1af-43d1-96eb-6e2984e54767 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:31:27.127926 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-4e1734c6-f1af-43d1-96eb-6e2984e54767 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.138091 Apr 30 13:31:27.128486 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 768/1644] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:31:26 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:31:28.145173 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-2ed891ce-08d2-404a-b8e3-3dd220a9c34a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:31:28.145792 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-2ed891ce-08d2-404a-b8e3-3dd220a9c34a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:31:28.153384 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2ed891ce-08d2-404a-b8e3-3dd220a9c34a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:28.153859 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2ed891ce-08d2-404a-b8e3-3dd220a9c34a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:28.154686 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2ed891ce-08d2-404a-b8e3-3dd220a9c34a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:28.155132 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2ed891ce-08d2-404a-b8e3-3dd220a9c34a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:28.414323 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-2ed891ce-08d2-404a-b8e3-3dd220a9c34a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:31:28.424163 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-2ed891ce-08d2-404a-b8e3-3dd220a9c34a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.282678 Apr 30 13:31:28.424747 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 877/1645] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:31:28 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:31:29.441194 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-18e93ad1-a6c9-4698-ae92-4df2b5d113b5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:31:29.441810 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-18e93ad1-a6c9-4698-ae92-4df2b5d113b5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:31:29.449005 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-18e93ad1-a6c9-4698-ae92-4df2b5d113b5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:29.449453 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-18e93ad1-a6c9-4698-ae92-4df2b5d113b5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:29.450352 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-18e93ad1-a6c9-4698-ae92-4df2b5d113b5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:29.450786 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-18e93ad1-a6c9-4698-ae92-4df2b5d113b5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:29.563595 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-18e93ad1-a6c9-4698-ae92-4df2b5d113b5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:31:29.571864 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-18e93ad1-a6c9-4698-ae92-4df2b5d113b5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.134967 Apr 30 13:31:29.572434 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 769/1646] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:31:29 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:31:30.588639 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-6d77f612-1df9-49b5-ad12-e9bd34314964 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:31:30.589286 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-6d77f612-1df9-49b5-ad12-e9bd34314964 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:31:30.597791 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6d77f612-1df9-49b5-ad12-e9bd34314964 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:30.598311 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6d77f612-1df9-49b5-ad12-e9bd34314964 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:30.599103 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6d77f612-1df9-49b5-ad12-e9bd34314964 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:30.599551 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6d77f612-1df9-49b5-ad12-e9bd34314964 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:30.714537 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-6d77f612-1df9-49b5-ad12-e9bd34314964 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:31:30.723309 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-6d77f612-1df9-49b5-ad12-e9bd34314964 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.138325 Apr 30 13:31:30.723890 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 878/1647] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:31:30 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:31:31.740968 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-4d312813-caeb-435c-96c6-e8cff96c5939 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:31:31.741586 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-4d312813-caeb-435c-96c6-e8cff96c5939 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:31:31.749893 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4d312813-caeb-435c-96c6-e8cff96c5939 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:31.750384 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4d312813-caeb-435c-96c6-e8cff96c5939 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:31.751187 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4d312813-caeb-435c-96c6-e8cff96c5939 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:31.751620 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4d312813-caeb-435c-96c6-e8cff96c5939 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:31.876688 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-4d312813-caeb-435c-96c6-e8cff96c5939 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:31:31.885546 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-4d312813-caeb-435c-96c6-e8cff96c5939 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.148334 Apr 30 13:31:31.886183 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 770/1648] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:31:31 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:31:32.903815 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-c5078abd-f7dd-4eb7-852d-f20677bc6089 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:31:32.904429 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-c5078abd-f7dd-4eb7-852d-f20677bc6089 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:31:32.912926 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c5078abd-f7dd-4eb7-852d-f20677bc6089 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:32.913380 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c5078abd-f7dd-4eb7-852d-f20677bc6089 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:32.914211 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c5078abd-f7dd-4eb7-852d-f20677bc6089 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:32.914653 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c5078abd-f7dd-4eb7-852d-f20677bc6089 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:33.033605 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-c5078abd-f7dd-4eb7-852d-f20677bc6089 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:31:33.042684 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-c5078abd-f7dd-4eb7-852d-f20677bc6089 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.142767 Apr 30 13:31:33.043268 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 879/1649] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:31:32 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:31:34.060232 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-ee089175-3406-4d50-9e0d-9381e668b18a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:31:34.060893 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-ee089175-3406-4d50-9e0d-9381e668b18a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:31:34.068581 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ee089175-3406-4d50-9e0d-9381e668b18a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:34.069033 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ee089175-3406-4d50-9e0d-9381e668b18a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:34.069826 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ee089175-3406-4d50-9e0d-9381e668b18a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:34.070282 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ee089175-3406-4d50-9e0d-9381e668b18a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:34.193761 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-ee089175-3406-4d50-9e0d-9381e668b18a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:31:34.202748 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-ee089175-3406-4d50-9e0d-9381e668b18a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.145756 Apr 30 13:31:34.203376 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 771/1650] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:31:34 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:31:35.223045 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-58e5a087-4b67-46ca-8c6a-14d8926c3a26 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:31:35.223045 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-58e5a087-4b67-46ca-8c6a-14d8926c3a26 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:31:35.227841 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-58e5a087-4b67-46ca-8c6a-14d8926c3a26 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:35.228294 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-58e5a087-4b67-46ca-8c6a-14d8926c3a26 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:35.229068 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-58e5a087-4b67-46ca-8c6a-14d8926c3a26 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:35.229499 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-58e5a087-4b67-46ca-8c6a-14d8926c3a26 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:35.345835 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-58e5a087-4b67-46ca-8c6a-14d8926c3a26 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:31:35.354079 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-58e5a087-4b67-46ca-8c6a-14d8926c3a26 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.138204 Apr 30 13:31:35.354643 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 880/1651] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:31:35 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:31:36.370590 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-4ab4efe4-6bd4-406a-835c-725d75a8261e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:31:36.371205 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-4ab4efe4-6bd4-406a-835c-725d75a8261e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:31:36.378643 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4ab4efe4-6bd4-406a-835c-725d75a8261e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:36.379092 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4ab4efe4-6bd4-406a-835c-725d75a8261e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:36.379864 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4ab4efe4-6bd4-406a-835c-725d75a8261e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:36.380337 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-4ab4efe4-6bd4-406a-835c-725d75a8261e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:36.492981 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-4ab4efe4-6bd4-406a-835c-725d75a8261e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:31:36.501140 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-4ab4efe4-6bd4-406a-835c-725d75a8261e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.134258 Apr 30 13:31:36.501694 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 772/1652] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:31:36 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:31:37.517950 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-71f37d3e-9630-4fec-996a-17657a525d4f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:31:37.518602 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-71f37d3e-9630-4fec-996a-17657a525d4f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:31:37.525880 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-71f37d3e-9630-4fec-996a-17657a525d4f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:37.526369 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-71f37d3e-9630-4fec-996a-17657a525d4f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:37.527153 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-71f37d3e-9630-4fec-996a-17657a525d4f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:37.527592 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-71f37d3e-9630-4fec-996a-17657a525d4f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:37.639276 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-71f37d3e-9630-4fec-996a-17657a525d4f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:31:37.648658 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-71f37d3e-9630-4fec-996a-17657a525d4f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.134481 Apr 30 13:31:37.658351 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 881/1653] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:31:37 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:31:38.666036 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-d762b796-5041-4b68-8f05-3e580c60b287 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:31:38.666757 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-d762b796-5041-4b68-8f05-3e580c60b287 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:31:38.674834 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d762b796-5041-4b68-8f05-3e580c60b287 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:38.675283 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d762b796-5041-4b68-8f05-3e580c60b287 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:38.676052 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d762b796-5041-4b68-8f05-3e580c60b287 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:38.676490 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d762b796-5041-4b68-8f05-3e580c60b287 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:38.863213 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-d762b796-5041-4b68-8f05-3e580c60b287 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:31:38.871920 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-d762b796-5041-4b68-8f05-3e580c60b287 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.209664 Apr 30 13:31:38.872479 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 773/1654] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:31:38 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:31:39.889327 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-47e51e9c-151e-4557-be3e-d37b5828caf7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:31:39.889948 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-47e51e9c-151e-4557-be3e-d37b5828caf7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:31:39.897291 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-47e51e9c-151e-4557-be3e-d37b5828caf7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:39.897743 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-47e51e9c-151e-4557-be3e-d37b5828caf7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:39.898679 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-47e51e9c-151e-4557-be3e-d37b5828caf7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:39.899121 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-47e51e9c-151e-4557-be3e-d37b5828caf7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:40.012972 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-47e51e9c-151e-4557-be3e-d37b5828caf7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:31:40.021987 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-47e51e9c-151e-4557-be3e-d37b5828caf7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.136473 Apr 30 13:31:40.022573 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 882/1655] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:31:39 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:31:41.038810 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-691d69c4-cc79-4e89-baa9-8bb983539de7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:31:41.039425 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-691d69c4-cc79-4e89-baa9-8bb983539de7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:31:41.046728 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-691d69c4-cc79-4e89-baa9-8bb983539de7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:41.047681 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-691d69c4-cc79-4e89-baa9-8bb983539de7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:41.048456 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-691d69c4-cc79-4e89-baa9-8bb983539de7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:41.048893 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-691d69c4-cc79-4e89-baa9-8bb983539de7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:41.160033 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-691d69c4-cc79-4e89-baa9-8bb983539de7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:31:41.168483 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-691d69c4-cc79-4e89-baa9-8bb983539de7 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.133642 Apr 30 13:31:41.169049 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 774/1656] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:31:41 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:31:42.185723 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-8c1476c5-00f1-44d4-8937-d64414cce472 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:31:42.186369 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-8c1476c5-00f1-44d4-8937-d64414cce472 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:31:42.194358 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8c1476c5-00f1-44d4-8937-d64414cce472 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:42.194810 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8c1476c5-00f1-44d4-8937-d64414cce472 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:42.195588 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8c1476c5-00f1-44d4-8937-d64414cce472 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:42.196029 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8c1476c5-00f1-44d4-8937-d64414cce472 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:42.361375 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-8c1476c5-00f1-44d4-8937-d64414cce472 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:31:42.369654 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-8c1476c5-00f1-44d4-8937-d64414cce472 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.187651 Apr 30 13:31:42.370229 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 883/1657] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:31:42 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:31:42.699609 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:31:42.699811 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: Fri Apr 30 13:31:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:31:43.386791 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-f73a5b57-381e-41e6-a75a-5d8e7b3d6d75 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:31:43.387335 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-f73a5b57-381e-41e6-a75a-5d8e7b3d6d75 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:31:43.395338 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f73a5b57-381e-41e6-a75a-5d8e7b3d6d75 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:43.395796 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f73a5b57-381e-41e6-a75a-5d8e7b3d6d75 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:43.396582 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f73a5b57-381e-41e6-a75a-5d8e7b3d6d75 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:43.397021 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f73a5b57-381e-41e6-a75a-5d8e7b3d6d75 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:43.512892 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-f73a5b57-381e-41e6-a75a-5d8e7b3d6d75 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:31:43.522718 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-f73a5b57-381e-41e6-a75a-5d8e7b3d6d75 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.139774 Apr 30 13:31:43.523300 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 775/1658] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:31:43 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:31:44.540277 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-d4816c6b-0bdd-4a94-b751-a69cc22815e8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:31:44.540902 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-d4816c6b-0bdd-4a94-b751-a69cc22815e8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:31:44.548748 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d4816c6b-0bdd-4a94-b751-a69cc22815e8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:44.549202 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d4816c6b-0bdd-4a94-b751-a69cc22815e8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:44.549996 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d4816c6b-0bdd-4a94-b751-a69cc22815e8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:44.550464 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d4816c6b-0bdd-4a94-b751-a69cc22815e8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:44.664095 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-d4816c6b-0bdd-4a94-b751-a69cc22815e8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:31:44.672985 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-d4816c6b-0bdd-4a94-b751-a69cc22815e8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.136793 Apr 30 13:31:44.673531 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 884/1659] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:31:44 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:31:45.689696 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-d1e21acf-bda6-4978-bc42-c5e1a88ab092 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:31:45.690336 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-d1e21acf-bda6-4978-bc42-c5e1a88ab092 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:31:45.697606 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d1e21acf-bda6-4978-bc42-c5e1a88ab092 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:45.698082 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d1e21acf-bda6-4978-bc42-c5e1a88ab092 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:45.698851 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d1e21acf-bda6-4978-bc42-c5e1a88ab092 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:45.699285 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d1e21acf-bda6-4978-bc42-c5e1a88ab092 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:45.824166 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-d1e21acf-bda6-4978-bc42-c5e1a88ab092 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:31:45.832467 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-d1e21acf-bda6-4978-bc42-c5e1a88ab092 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.146431 Apr 30 13:31:45.833027 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 776/1660] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:31:45 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:31:46.848840 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-09be05a0-bc02-4bb4-b032-0358ef9eb069 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:31:46.850291 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-09be05a0-bc02-4bb4-b032-0358ef9eb069 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:31:46.857932 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-09be05a0-bc02-4bb4-b032-0358ef9eb069 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:46.858498 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-09be05a0-bc02-4bb4-b032-0358ef9eb069 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:46.859348 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-09be05a0-bc02-4bb4-b032-0358ef9eb069 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:46.860374 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-09be05a0-bc02-4bb4-b032-0358ef9eb069 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:46.975175 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-09be05a0-bc02-4bb4-b032-0358ef9eb069 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:31:46.983258 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-09be05a0-bc02-4bb4-b032-0358ef9eb069 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.138123 Apr 30 13:31:46.983804 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 885/1661] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:31:46 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:31:47.999294 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-dacca742-b2ad-4e62-a5cb-7e8f3d40f719 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:31:47.999909 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-dacca742-b2ad-4e62-a5cb-7e8f3d40f719 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:31:48.007798 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-dacca742-b2ad-4e62-a5cb-7e8f3d40f719 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:48.008244 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-dacca742-b2ad-4e62-a5cb-7e8f3d40f719 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:48.009018 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-dacca742-b2ad-4e62-a5cb-7e8f3d40f719 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:48.009455 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-dacca742-b2ad-4e62-a5cb-7e8f3d40f719 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:48.120812 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-dacca742-b2ad-4e62-a5cb-7e8f3d40f719 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:31:48.129654 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-dacca742-b2ad-4e62-a5cb-7e8f3d40f719 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.134001 Apr 30 13:31:48.130245 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 777/1662] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:31:47 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:31:49.147025 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-14401c6d-4a45-4898-a1e9-8047bc13deb8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:31:49.147668 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-14401c6d-4a45-4898-a1e9-8047bc13deb8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:31:49.154846 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-14401c6d-4a45-4898-a1e9-8047bc13deb8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:49.155303 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-14401c6d-4a45-4898-a1e9-8047bc13deb8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:49.156086 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-14401c6d-4a45-4898-a1e9-8047bc13deb8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:49.156530 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-14401c6d-4a45-4898-a1e9-8047bc13deb8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:49.271059 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-14401c6d-4a45-4898-a1e9-8047bc13deb8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:31:49.280011 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-14401c6d-4a45-4898-a1e9-8047bc13deb8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.136482 Apr 30 13:31:49.280622 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 886/1663] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:31:49 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:31:50.297088 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-88351570-a076-44f7-8b64-bc077a17029a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:31:50.297676 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-88351570-a076-44f7-8b64-bc077a17029a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:31:50.305088 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-88351570-a076-44f7-8b64-bc077a17029a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:50.305541 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-88351570-a076-44f7-8b64-bc077a17029a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:50.306351 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-88351570-a076-44f7-8b64-bc077a17029a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:50.306792 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-88351570-a076-44f7-8b64-bc077a17029a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:50.418759 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-88351570-a076-44f7-8b64-bc077a17029a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:31:50.427330 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-88351570-a076-44f7-8b64-bc077a17029a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.134088 Apr 30 13:31:50.428056 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 778/1664] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:31:50 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:31:51.444726 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-33cb7089-5e86-4ad0-adab-c99ee9bec3d1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:31:51.445380 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-33cb7089-5e86-4ad0-adab-c99ee9bec3d1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:31:51.452655 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-33cb7089-5e86-4ad0-adab-c99ee9bec3d1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:51.453103 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-33cb7089-5e86-4ad0-adab-c99ee9bec3d1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:51.453902 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-33cb7089-5e86-4ad0-adab-c99ee9bec3d1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:51.454976 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-33cb7089-5e86-4ad0-adab-c99ee9bec3d1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:51.567290 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-33cb7089-5e86-4ad0-adab-c99ee9bec3d1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:31:51.575594 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-33cb7089-5e86-4ad0-adab-c99ee9bec3d1 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.134617 Apr 30 13:31:51.576294 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 887/1665] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:31:51 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:31:52.592570 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-723bfd8b-2e72-478c-8d0e-367a918d9781 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:31:52.593192 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-723bfd8b-2e72-478c-8d0e-367a918d9781 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:31:52.601377 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-723bfd8b-2e72-478c-8d0e-367a918d9781 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:52.601833 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-723bfd8b-2e72-478c-8d0e-367a918d9781 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:52.602650 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-723bfd8b-2e72-478c-8d0e-367a918d9781 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:52.603092 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-723bfd8b-2e72-478c-8d0e-367a918d9781 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:52.724176 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-723bfd8b-2e72-478c-8d0e-367a918d9781 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:31:52.732647 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-723bfd8b-2e72-478c-8d0e-367a918d9781 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.143770 Apr 30 13:31:52.733209 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 779/1666] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:31:52 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:31:53.749776 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-a3021861-1b61-46f2-8ea2-fe428f0c0477 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:31:53.750444 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-a3021861-1b61-46f2-8ea2-fe428f0c0477 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:31:53.757940 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a3021861-1b61-46f2-8ea2-fe428f0c0477 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:53.758432 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a3021861-1b61-46f2-8ea2-fe428f0c0477 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:53.759216 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a3021861-1b61-46f2-8ea2-fe428f0c0477 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:53.759654 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a3021861-1b61-46f2-8ea2-fe428f0c0477 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:53.875321 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-a3021861-1b61-46f2-8ea2-fe428f0c0477 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:31:53.884461 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-a3021861-1b61-46f2-8ea2-fe428f0c0477 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.138343 Apr 30 13:31:53.885036 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 888/1667] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:31:53 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:31:54.901789 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-cfb5fbee-36d5-4714-be34-1e50ceae9f3c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:31:54.902440 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-cfb5fbee-36d5-4714-be34-1e50ceae9f3c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:31:54.910747 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cfb5fbee-36d5-4714-be34-1e50ceae9f3c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:54.911461 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cfb5fbee-36d5-4714-be34-1e50ceae9f3c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:54.912245 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cfb5fbee-36d5-4714-be34-1e50ceae9f3c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:54.912688 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cfb5fbee-36d5-4714-be34-1e50ceae9f3c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:55.023687 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-cfb5fbee-36d5-4714-be34-1e50ceae9f3c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:31:55.031874 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-cfb5fbee-36d5-4714-be34-1e50ceae9f3c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.133800 Apr 30 13:31:55.033012 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 780/1668] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:31:54 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:31:56.049574 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-91c044eb-a6bb-47fe-beb8-a33f69adac39 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:31:56.050223 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-91c044eb-a6bb-47fe-beb8-a33f69adac39 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:31:56.057495 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-91c044eb-a6bb-47fe-beb8-a33f69adac39 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:56.057941 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-91c044eb-a6bb-47fe-beb8-a33f69adac39 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:56.058749 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-91c044eb-a6bb-47fe-beb8-a33f69adac39 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:56.059187 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-91c044eb-a6bb-47fe-beb8-a33f69adac39 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:56.172607 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-91c044eb-a6bb-47fe-beb8-a33f69adac39 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:31:56.181493 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-91c044eb-a6bb-47fe-beb8-a33f69adac39 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.136281 Apr 30 13:31:56.182061 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 889/1669] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:31:56 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:31:57.198804 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-b562cc84-f0d3-4261-88ad-30dbf4d18bda tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:31:57.199419 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-b562cc84-f0d3-4261-88ad-30dbf4d18bda tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:31:57.207342 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b562cc84-f0d3-4261-88ad-30dbf4d18bda tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:57.207790 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b562cc84-f0d3-4261-88ad-30dbf4d18bda tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:57.208562 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b562cc84-f0d3-4261-88ad-30dbf4d18bda tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:57.208996 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b562cc84-f0d3-4261-88ad-30dbf4d18bda tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:57.320118 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-b562cc84-f0d3-4261-88ad-30dbf4d18bda tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:31:57.328283 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-b562cc84-f0d3-4261-88ad-30dbf4d18bda tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.133152 Apr 30 13:31:57.328843 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 781/1670] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:31:57 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:31:58.344760 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-2e4751f5-5518-44dc-8173-b0cf9cb1168c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:31:58.345376 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-2e4751f5-5518-44dc-8173-b0cf9cb1168c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:31:58.353262 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2e4751f5-5518-44dc-8173-b0cf9cb1168c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:58.353720 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2e4751f5-5518-44dc-8173-b0cf9cb1168c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:58.354534 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2e4751f5-5518-44dc-8173-b0cf9cb1168c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:58.354976 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2e4751f5-5518-44dc-8173-b0cf9cb1168c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:58.468030 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-2e4751f5-5518-44dc-8173-b0cf9cb1168c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:31:58.477311 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-2e4751f5-5518-44dc-8173-b0cf9cb1168c tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.136214 Apr 30 13:31:58.478109 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 890/1671] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:31:58 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:31:59.494399 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-de3cc5f7-b8e7-425d-b83a-c5e4354cffef tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:31:59.494921 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-de3cc5f7-b8e7-425d-b83a-c5e4354cffef tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:31:59.502267 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-de3cc5f7-b8e7-425d-b83a-c5e4354cffef tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:59.502722 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-de3cc5f7-b8e7-425d-b83a-c5e4354cffef tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:59.503498 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-de3cc5f7-b8e7-425d-b83a-c5e4354cffef tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:31:59.504255 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-de3cc5f7-b8e7-425d-b83a-c5e4354cffef tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:31:59.619877 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-de3cc5f7-b8e7-425d-b83a-c5e4354cffef tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:31:59.628242 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-de3cc5f7-b8e7-425d-b83a-c5e4354cffef tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.137835 Apr 30 13:31:59.628801 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 782/1672] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:31:59 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:32:00.644540 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-eb9afb77-1d02-4fea-b1a3-fc14615b0cac tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:32:00.645153 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-eb9afb77-1d02-4fea-b1a3-fc14615b0cac tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:32:00.652548 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-eb9afb77-1d02-4fea-b1a3-fc14615b0cac tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:32:00.653005 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-eb9afb77-1d02-4fea-b1a3-fc14615b0cac tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:32:00.653792 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-eb9afb77-1d02-4fea-b1a3-fc14615b0cac tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:32:00.654267 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-eb9afb77-1d02-4fea-b1a3-fc14615b0cac tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:32:00.769397 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-eb9afb77-1d02-4fea-b1a3-fc14615b0cac tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:32:00.777787 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-eb9afb77-1d02-4fea-b1a3-fc14615b0cac tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.136933 Apr 30 13:32:00.778381 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 891/1673] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:32:00 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:32:01.795246 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-d6b11c13-5bf5-4424-890f-df50934b85b0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:32:01.795872 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-d6b11c13-5bf5-4424-890f-df50934b85b0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:32:01.804217 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d6b11c13-5bf5-4424-890f-df50934b85b0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:32:01.804741 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d6b11c13-5bf5-4424-890f-df50934b85b0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:32:01.805539 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d6b11c13-5bf5-4424-890f-df50934b85b0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:32:01.805977 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-d6b11c13-5bf5-4424-890f-df50934b85b0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:32:02.057065 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-d6b11c13-5bf5-4424-890f-df50934b85b0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:32:02.065270 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-d6b11c13-5bf5-4424-890f-df50934b85b0 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.273698 Apr 30 13:32:02.065849 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 783/1674] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:32:01 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:32:02.459021 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:32:02.459637 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: Fri Apr 30 13:32:02 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:32:03.083129 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-c4af1755-91bc-43d5-9a33-8ec2ce563952 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:32:03.083678 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-c4af1755-91bc-43d5-9a33-8ec2ce563952 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:32:03.091029 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c4af1755-91bc-43d5-9a33-8ec2ce563952 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:32:03.091509 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c4af1755-91bc-43d5-9a33-8ec2ce563952 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:32:03.092273 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c4af1755-91bc-43d5-9a33-8ec2ce563952 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:32:03.092717 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c4af1755-91bc-43d5-9a33-8ec2ce563952 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:32:03.207807 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-c4af1755-91bc-43d5-9a33-8ec2ce563952 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:32:03.215953 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-c4af1755-91bc-43d5-9a33-8ec2ce563952 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.137282 Apr 30 13:32:03.216505 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 892/1675] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:32:03 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:32:04.232029 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-93bdf511-fa2b-4e28-af15-69128cd0fbe8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:32:04.232655 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-93bdf511-fa2b-4e28-af15-69128cd0fbe8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:32:04.240088 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-93bdf511-fa2b-4e28-af15-69128cd0fbe8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:32:04.240548 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-93bdf511-fa2b-4e28-af15-69128cd0fbe8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:32:04.241330 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-93bdf511-fa2b-4e28-af15-69128cd0fbe8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:32:04.241771 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-93bdf511-fa2b-4e28-af15-69128cd0fbe8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:32:04.355911 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-93bdf511-fa2b-4e28-af15-69128cd0fbe8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:32:04.364182 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-93bdf511-fa2b-4e28-af15-69128cd0fbe8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.135821 Apr 30 13:32:04.364742 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 784/1676] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:32:04 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:32:05.381266 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-e2d15873-7f89-451a-a3d8-20ae4ab3307f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:32:05.381894 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-e2d15873-7f89-451a-a3d8-20ae4ab3307f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:32:05.389262 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e2d15873-7f89-451a-a3d8-20ae4ab3307f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:32:05.389716 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e2d15873-7f89-451a-a3d8-20ae4ab3307f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:32:05.390554 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e2d15873-7f89-451a-a3d8-20ae4ab3307f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:32:05.390999 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e2d15873-7f89-451a-a3d8-20ae4ab3307f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:32:05.502747 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-e2d15873-7f89-451a-a3d8-20ae4ab3307f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:32:05.511627 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-e2d15873-7f89-451a-a3d8-20ae4ab3307f tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.134334 Apr 30 13:32:05.512220 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 893/1677] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:32:05 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:32:06.528950 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-c8fb8b3e-8091-4b2e-8f58-370751e488aa tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:32:06.529567 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-c8fb8b3e-8091-4b2e-8f58-370751e488aa tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:32:06.537862 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c8fb8b3e-8091-4b2e-8f58-370751e488aa tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:32:06.538341 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c8fb8b3e-8091-4b2e-8f58-370751e488aa tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:32:06.539128 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c8fb8b3e-8091-4b2e-8f58-370751e488aa tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:32:06.539563 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c8fb8b3e-8091-4b2e-8f58-370751e488aa tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:32:06.652930 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-c8fb8b3e-8091-4b2e-8f58-370751e488aa tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:32:06.662160 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-c8fb8b3e-8091-4b2e-8f58-370751e488aa tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.136889 Apr 30 13:32:06.662818 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 785/1678] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:32:06 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:32:07.680017 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-1aa42547-c5f4-4082-aeb3-de757f252c21 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:32:07.680629 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-1aa42547-c5f4-4082-aeb3-de757f252c21 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:32:07.688908 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1aa42547-c5f4-4082-aeb3-de757f252c21 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:32:07.689361 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1aa42547-c5f4-4082-aeb3-de757f252c21 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:32:07.690164 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1aa42547-c5f4-4082-aeb3-de757f252c21 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:32:07.690608 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1aa42547-c5f4-4082-aeb3-de757f252c21 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:32:07.806530 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-1aa42547-c5f4-4082-aeb3-de757f252c21 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:32:07.814815 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-1aa42547-c5f4-4082-aeb3-de757f252c21 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.138458 Apr 30 13:32:07.815453 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 894/1679] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:32:07 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:32:08.837282 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-5ddde62b-6492-43dd-b60c-1a048b7d699d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:32:08.837282 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-5ddde62b-6492-43dd-b60c-1a048b7d699d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:32:08.841040 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5ddde62b-6492-43dd-b60c-1a048b7d699d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:32:08.841495 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5ddde62b-6492-43dd-b60c-1a048b7d699d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:32:08.842365 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5ddde62b-6492-43dd-b60c-1a048b7d699d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:32:08.842810 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5ddde62b-6492-43dd-b60c-1a048b7d699d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:32:08.955130 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-5ddde62b-6492-43dd-b60c-1a048b7d699d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:32:08.963920 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-5ddde62b-6492-43dd-b60c-1a048b7d699d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.135374 Apr 30 13:32:08.964514 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 786/1680] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:32:08 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:32:09.980442 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-613355ce-2d03-4954-9d8f-624f3606635e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:32:09.981090 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-613355ce-2d03-4954-9d8f-624f3606635e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:32:09.988641 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-613355ce-2d03-4954-9d8f-624f3606635e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:32:09.989099 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-613355ce-2d03-4954-9d8f-624f3606635e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:32:09.989884 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-613355ce-2d03-4954-9d8f-624f3606635e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:32:09.990353 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-613355ce-2d03-4954-9d8f-624f3606635e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:32:10.111058 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-613355ce-2d03-4954-9d8f-624f3606635e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:32:10.119478 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-613355ce-2d03-4954-9d8f-624f3606635e tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.142770 Apr 30 13:32:10.120033 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 895/1681] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:32:09 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:32:11.136035 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-ebe1a48e-ba86-4be7-b26d-9459504ce0ab tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:32:11.136589 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-ebe1a48e-ba86-4be7-b26d-9459504ce0ab tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:32:11.144031 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ebe1a48e-ba86-4be7-b26d-9459504ce0ab tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:32:11.144559 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ebe1a48e-ba86-4be7-b26d-9459504ce0ab tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:32:11.145346 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ebe1a48e-ba86-4be7-b26d-9459504ce0ab tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:32:11.145789 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ebe1a48e-ba86-4be7-b26d-9459504ce0ab tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:32:11.259863 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-ebe1a48e-ba86-4be7-b26d-9459504ce0ab tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:32:11.268034 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-ebe1a48e-ba86-4be7-b26d-9459504ce0ab tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.135794 Apr 30 13:32:11.268587 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 787/1682] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:32:11 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:32:12.284372 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b346c3a9-d46b-4ad2-a2dc-18fb632df6fd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:32:12.284992 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-b346c3a9-d46b-4ad2-a2dc-18fb632df6fd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:32:12.292798 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b346c3a9-d46b-4ad2-a2dc-18fb632df6fd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:32:12.293250 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b346c3a9-d46b-4ad2-a2dc-18fb632df6fd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:32:12.294049 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b346c3a9-d46b-4ad2-a2dc-18fb632df6fd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:32:12.294494 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b346c3a9-d46b-4ad2-a2dc-18fb632df6fd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:32:12.406228 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-b346c3a9-d46b-4ad2-a2dc-18fb632df6fd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:32:12.414762 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b346c3a9-d46b-4ad2-a2dc-18fb632df6fd tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.134044 Apr 30 13:32:12.415324 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 896/1683] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:32:12 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:32:13.432555 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-8b5ff641-d1b8-43b0-802d-9a7a85e57bf5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:32:13.433311 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-8b5ff641-d1b8-43b0-802d-9a7a85e57bf5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:32:13.440717 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8b5ff641-d1b8-43b0-802d-9a7a85e57bf5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:32:13.441167 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8b5ff641-d1b8-43b0-802d-9a7a85e57bf5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:32:13.442460 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8b5ff641-d1b8-43b0-802d-9a7a85e57bf5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:32:13.442894 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8b5ff641-d1b8-43b0-802d-9a7a85e57bf5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:32:13.555505 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-8b5ff641-d1b8-43b0-802d-9a7a85e57bf5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:32:13.563661 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-8b5ff641-d1b8-43b0-802d-9a7a85e57bf5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.134838 Apr 30 13:32:13.564216 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 788/1684] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:32:13 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:32:14.580651 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-387c236e-a8ac-444b-8338-155510e6b1c2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:32:14.581307 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-387c236e-a8ac-444b-8338-155510e6b1c2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:32:14.589234 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-387c236e-a8ac-444b-8338-155510e6b1c2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:32:14.589693 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-387c236e-a8ac-444b-8338-155510e6b1c2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:32:14.590514 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-387c236e-a8ac-444b-8338-155510e6b1c2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:32:14.590959 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-387c236e-a8ac-444b-8338-155510e6b1c2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:32:14.705138 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-387c236e-a8ac-444b-8338-155510e6b1c2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:32:14.713798 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-387c236e-a8ac-444b-8338-155510e6b1c2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.136913 Apr 30 13:32:14.714398 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 897/1685] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:32:14 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:32:15.730311 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-c1c08026-f57e-47c4-a4f2-d0320b461372 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:32:15.730926 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-c1c08026-f57e-47c4-a4f2-d0320b461372 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:32:15.738157 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c1c08026-f57e-47c4-a4f2-d0320b461372 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:32:15.738696 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c1c08026-f57e-47c4-a4f2-d0320b461372 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:32:15.739498 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c1c08026-f57e-47c4-a4f2-d0320b461372 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:32:15.739939 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c1c08026-f57e-47c4-a4f2-d0320b461372 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:32:15.851161 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-c1c08026-f57e-47c4-a4f2-d0320b461372 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:32:15.859396 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-c1c08026-f57e-47c4-a4f2-d0320b461372 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.132740 Apr 30 13:32:15.860142 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 789/1686] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:32:15 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:32:16.876134 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-de14efe4-f0b3-4042-9bb2-7130e106f5be tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:32:16.876739 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-de14efe4-f0b3-4042-9bb2-7130e106f5be tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:32:16.884320 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-de14efe4-f0b3-4042-9bb2-7130e106f5be tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:32:16.884776 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-de14efe4-f0b3-4042-9bb2-7130e106f5be tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:32:16.885564 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-de14efe4-f0b3-4042-9bb2-7130e106f5be tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:32:16.885990 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-de14efe4-f0b3-4042-9bb2-7130e106f5be tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:32:17.003105 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-de14efe4-f0b3-4042-9bb2-7130e106f5be tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:32:17.012193 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-de14efe4-f0b3-4042-9bb2-7130e106f5be tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.139800 Apr 30 13:32:17.012752 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 898/1687] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:32:16 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:32:18.029233 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-60a2cc60-597d-4f0a-ad16-057a4751e127 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:32:18.029776 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-60a2cc60-597d-4f0a-ad16-057a4751e127 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:32:18.037398 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-60a2cc60-597d-4f0a-ad16-057a4751e127 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:32:18.037852 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-60a2cc60-597d-4f0a-ad16-057a4751e127 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:32:18.038671 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-60a2cc60-597d-4f0a-ad16-057a4751e127 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:32:18.039114 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-60a2cc60-597d-4f0a-ad16-057a4751e127 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:32:18.156701 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-60a2cc60-597d-4f0a-ad16-057a4751e127 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:32:18.165385 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-60a2cc60-597d-4f0a-ad16-057a4751e127 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.139934 Apr 30 13:32:18.173961 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 790/1688] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:32:18 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:32:19.181825 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-3cfa44e6-5383-4eeb-8212-069ef62d04a2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:32:19.182577 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-3cfa44e6-5383-4eeb-8212-069ef62d04a2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:32:19.189844 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3cfa44e6-5383-4eeb-8212-069ef62d04a2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:32:19.190322 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3cfa44e6-5383-4eeb-8212-069ef62d04a2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:32:19.191098 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3cfa44e6-5383-4eeb-8212-069ef62d04a2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:32:19.191561 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3cfa44e6-5383-4eeb-8212-069ef62d04a2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:32:19.306583 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-3cfa44e6-5383-4eeb-8212-069ef62d04a2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:32:19.314883 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-3cfa44e6-5383-4eeb-8212-069ef62d04a2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.136970 Apr 30 13:32:19.315443 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 899/1689] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:32:19 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:32:20.332166 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-623f2bb6-5ee7-4972-8132-4746e23e442d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:32:20.332782 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-623f2bb6-5ee7-4972-8132-4746e23e442d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:32:20.340744 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-623f2bb6-5ee7-4972-8132-4746e23e442d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:32:20.341201 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-623f2bb6-5ee7-4972-8132-4746e23e442d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:32:20.341993 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-623f2bb6-5ee7-4972-8132-4746e23e442d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:32:20.342465 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-623f2bb6-5ee7-4972-8132-4746e23e442d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:32:20.457670 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-623f2bb6-5ee7-4972-8132-4746e23e442d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:32:20.467105 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-623f2bb6-5ee7-4972-8132-4746e23e442d tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.138675 Apr 30 13:32:20.467666 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 791/1690] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:32:20 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:32:21.483911 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-f82b6313-3372-4c77-bf42-1004c1b94076 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:32:21.484519 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-f82b6313-3372-4c77-bf42-1004c1b94076 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:32:21.491672 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f82b6313-3372-4c77-bf42-1004c1b94076 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:32:21.492117 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f82b6313-3372-4c77-bf42-1004c1b94076 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:32:21.493781 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f82b6313-3372-4c77-bf42-1004c1b94076 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:32:21.494248 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f82b6313-3372-4c77-bf42-1004c1b94076 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:32:21.608895 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-f82b6313-3372-4c77-bf42-1004c1b94076 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:32:21.617185 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-f82b6313-3372-4c77-bf42-1004c1b94076 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.137059 Apr 30 13:32:21.618553 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 900/1691] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:32:21 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:32:22.634664 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-b7aa635c-05a4-4f6b-8cac-68ed32b5d4b2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:32:22.635327 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-b7aa635c-05a4-4f6b-8cac-68ed32b5d4b2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:32:22.642731 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b7aa635c-05a4-4f6b-8cac-68ed32b5d4b2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:32:22.643186 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b7aa635c-05a4-4f6b-8cac-68ed32b5d4b2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:32:22.643968 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b7aa635c-05a4-4f6b-8cac-68ed32b5d4b2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:32:22.644410 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b7aa635c-05a4-4f6b-8cac-68ed32b5d4b2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:32:22.756853 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-b7aa635c-05a4-4f6b-8cac-68ed32b5d4b2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:32:22.765109 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-b7aa635c-05a4-4f6b-8cac-68ed32b5d4b2 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.134312 Apr 30 13:32:22.765659 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 792/1692] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:32:22 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:32:23.781687 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-2b8de891-9402-4099-a1d8-8adc57b3233a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:32:23.782333 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-2b8de891-9402-4099-a1d8-8adc57b3233a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:32:23.789786 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2b8de891-9402-4099-a1d8-8adc57b3233a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:32:23.790282 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2b8de891-9402-4099-a1d8-8adc57b3233a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:32:23.791067 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2b8de891-9402-4099-a1d8-8adc57b3233a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:32:23.791508 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2b8de891-9402-4099-a1d8-8adc57b3233a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:32:23.911329 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-2b8de891-9402-4099-a1d8-8adc57b3233a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:32:23.920149 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-2b8de891-9402-4099-a1d8-8adc57b3233a tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.142097 Apr 30 13:32:23.920706 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 901/1693] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:32:23 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:32:24.937437 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-243fe1aa-f378-491e-9d2c-61c3e77f05c5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:32:24.938143 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-243fe1aa-f378-491e-9d2c-61c3e77f05c5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:32:24.945880 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-243fe1aa-f378-491e-9d2c-61c3e77f05c5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:32:24.946366 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-243fe1aa-f378-491e-9d2c-61c3e77f05c5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:32:24.947167 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-243fe1aa-f378-491e-9d2c-61c3e77f05c5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:32:24.947608 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-243fe1aa-f378-491e-9d2c-61c3e77f05c5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:32:25.062046 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-243fe1aa-f378-491e-9d2c-61c3e77f05c5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a10ef3b5434242cc8c5b15a1bb36f735', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d9dbe0005674e0899b90b9db4c9423e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:32:25.070977 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-243fe1aa-f378-491e-9d2c-61c3e77f05c5 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 200 len: 1220 microversion: 2.1 time: 0.136560 Apr 30 13:32:25.071464 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 793/1694] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:32:24 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 1220 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:32:26.087596 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-4ea152d4-d9c0-45a7-80ce-24cb832222e8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:32:26.088207 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-4ea152d4-d9c0-45a7-80ce-24cb832222e8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] [instance: 9d5ad250-b1c3-4849-9018-b9814f65927c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:32:26.095490 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4ea152d4-d9c0-45a7-80ce-24cb832222e8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:32:26.095946 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4ea152d4-d9c0-45a7-80ce-24cb832222e8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:32:26.096725 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4ea152d4-d9c0-45a7-80ce-24cb832222e8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:32:26.097168 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4ea152d4-d9c0-45a7-80ce-24cb832222e8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:32:26.146226 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.wsgi [None req-4ea152d4-d9c0-45a7-80ce-24cb832222e8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] HTTP exception thrown: Instance 9d5ad250-b1c3-4849-9018-b9814f65927c could not be found. Apr 30 13:32:26.146831 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-4ea152d4-d9c0-45a7-80ce-24cb832222e8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Returning 404 to user: Instance 9d5ad250-b1c3-4849-9018-b9814f65927c could not be found. {{(pid=87933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:32:26.147661 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-4ea152d4-d9c0-45a7-80ce-24cb832222e8 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c" status: 404 len: 111 microversion: 2.1 time: 0.063973 Apr 30 13:32:26.148192 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 902/1695] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:32:26 2021] GET /compute/v2.1/servers/9d5ad250-b1c3-4849-9018-b9814f65927c => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:32:26.361828 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-516e13b6-2d23-4641-ad5f-0a53603e76a4 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] Calling method '.version_select at 0x7f7500b40af0>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:32:26.386227 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-516e13b6-2d23-4641-ad5f-0a53603e76a4 tempest-TestShelveInstance-184438094 tempest-TestShelveInstance-184438094-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2009375504" status: 202 len: 0 microversion: 2.1 time: 0.027989 Apr 30 13:32:26.387165 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 794/1696] 10.222.0.79 () {58 vars in 1254 bytes} [Fri Apr 30 13:32:26 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2009375504 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:33:19.666385 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-a00a61aa-abfe-4df4-9684-90f0080d0c3b tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:33:19.666948 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-a00a61aa-abfe-4df4-9684-90f0080d0c3b tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:33:19.674326 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a00a61aa-abfe-4df4-9684-90f0080d0c3b tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:19.674783 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a00a61aa-abfe-4df4-9684-90f0080d0c3b tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:19.675573 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a00a61aa-abfe-4df4-9684-90f0080d0c3b tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:19.676022 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a00a61aa-abfe-4df4-9684-90f0080d0c3b tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:19.736609 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-a00a61aa-abfe-4df4-9684-90f0080d0c3b tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Going to try to terminate instance {{(pid=87933) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 13:33:19.836241 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a00a61aa-abfe-4df4-9684-90f0080d0c3b tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [066fd332-dd37-4bc3-8c9b-71d919bd46a1] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 30 13:33:20.854527 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO oslo.messaging._drivers.impl_rabbit [None req-a00a61aa-abfe-4df4-9684-90f0080d0c3b tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [066fd332-dd37-4bc3-8c9b-71d919bd46a1] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 33668. Apr 30 13:33:20.876790 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-a00a61aa-abfe-4df4-9684-90f0080d0c3b tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 204 len: 0 microversion: 2.1 time: 1.214479 Apr 30 13:33:20.877503 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 903/1697] 10.222.0.79 () {58 vars in 1239 bytes} [Fri Apr 30 13:33:19 2021] DELETE /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 0 bytes in 1216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 13:33:20.883314 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1abdcfbc-0fea-4857-8557-cdc275d2ef0c] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 30 13:33:20.886745 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-0890ab76-d33f-4ffc-b007-56c805df91bf tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:33:20.887589 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-0890ab76-d33f-4ffc-b007-56c805df91bf tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:33:20.894896 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0890ab76-d33f-4ffc-b007-56c805df91bf tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:20.895357 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0890ab76-d33f-4ffc-b007-56c805df91bf tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:20.896151 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0890ab76-d33f-4ffc-b007-56c805df91bf tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:20.896597 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0890ab76-d33f-4ffc-b007-56c805df91bf tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:21.094611 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-0890ab76-d33f-4ffc-b007-56c805df91bf tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:33:21.103272 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-0890ab76-d33f-4ffc-b007-56c805df91bf tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1561 microversion: 2.1 time: 0.221341 Apr 30 13:33:21.103828 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 795/1698] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:33:20 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1561 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:33:22.121433 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-59d25b7d-7ae0-4b62-949d-e0e6f3426ae0 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:33:22.122258 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-59d25b7d-7ae0-4b62-949d-e0e6f3426ae0 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:33:22.129786 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-59d25b7d-7ae0-4b62-949d-e0e6f3426ae0 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:22.130274 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-59d25b7d-7ae0-4b62-949d-e0e6f3426ae0 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:22.131058 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-59d25b7d-7ae0-4b62-949d-e0e6f3426ae0 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:22.131499 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-59d25b7d-7ae0-4b62-949d-e0e6f3426ae0 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:22.332596 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-59d25b7d-7ae0-4b62-949d-e0e6f3426ae0 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:33:22.343271 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-59d25b7d-7ae0-4b62-949d-e0e6f3426ae0 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1561 microversion: 2.1 time: 0.226606 Apr 30 13:33:22.344251 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 904/1699] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:33:22 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1561 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:33:22.423361 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO oslo.messaging._drivers.impl_rabbit [-] [1abdcfbc-0fea-4857-8557-cdc275d2ef0c] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 33688. Apr 30 13:33:22.541245 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [req-19d068d0-721d-499d-be73-2d167af7e308 req-e58a94e0-0f69-4a54-9939-ac8aef33fcfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4c66a3a-0046-442b-a6c9-54494d8a7722", "name": "network-vif-deleted", "tag": "3954223d-04e7-4b33-80b7-6667a5b1731c"}]} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:33:22.542923 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:33:22.542923 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: warnings.warn(msg) Apr 30 13:33:22.551365 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-19d068d0-721d-499d-be73-2d167af7e308 req-e58a94e0-0f69-4a54-9939-ac8aef33fcfd service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:22.551812 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-19d068d0-721d-499d-be73-2d167af7e308 req-e58a94e0-0f69-4a54-9939-ac8aef33fcfd service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:22.567348 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.compute.server_external_events [req-19d068d0-721d-499d-be73-2d167af7e308 req-e58a94e0-0f69-4a54-9939-ac8aef33fcfd service nova] Creating event network-vif-deleted:3954223d-04e7-4b33-80b7-6667a5b1731c for instance c4c66a3a-0046-442b-a6c9-54494d8a7722 on hv-cinder-78836 Apr 30 13:33:22.572801 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [req-19d068d0-721d-499d-be73-2d167af7e308 req-e58a94e0-0f69-4a54-9939-ac8aef33fcfd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174298 Apr 30 13:33:22.573370 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 796/1700] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:33:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:33:23.360689 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-d7786ed1-e94a-4c85-9904-dd87a442ee36 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:33:23.361322 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-d7786ed1-e94a-4c85-9904-dd87a442ee36 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:33:23.369403 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d7786ed1-e94a-4c85-9904-dd87a442ee36 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:23.369851 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d7786ed1-e94a-4c85-9904-dd87a442ee36 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:23.370653 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d7786ed1-e94a-4c85-9904-dd87a442ee36 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:23.371091 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d7786ed1-e94a-4c85-9904-dd87a442ee36 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:23.484507 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-d7786ed1-e94a-4c85-9904-dd87a442ee36 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:33:23.493649 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-d7786ed1-e94a-4c85-9904-dd87a442ee36 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.136175 Apr 30 13:33:23.494227 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 905/1701] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:33:23 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:33:24.511422 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-9b9ee31f-894d-47fc-8e65-f9631a697b6b tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:33:24.512161 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-9b9ee31f-894d-47fc-8e65-f9631a697b6b tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:33:24.519854 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9b9ee31f-894d-47fc-8e65-f9631a697b6b tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:24.520305 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9b9ee31f-894d-47fc-8e65-f9631a697b6b tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:24.521084 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9b9ee31f-894d-47fc-8e65-f9631a697b6b tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:24.521525 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9b9ee31f-894d-47fc-8e65-f9631a697b6b tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:24.749094 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-9b9ee31f-894d-47fc-8e65-f9631a697b6b tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:33:24.758111 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-9b9ee31f-894d-47fc-8e65-f9631a697b6b tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.251416 Apr 30 13:33:24.759303 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 797/1702] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:33:24 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:33:25.776151 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-db4a054f-5e45-42d6-a8ba-a29f7c9d02b7 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:33:25.776766 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-db4a054f-5e45-42d6-a8ba-a29f7c9d02b7 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:33:25.784126 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-db4a054f-5e45-42d6-a8ba-a29f7c9d02b7 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:25.784577 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-db4a054f-5e45-42d6-a8ba-a29f7c9d02b7 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:25.785349 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-db4a054f-5e45-42d6-a8ba-a29f7c9d02b7 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:25.785783 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-db4a054f-5e45-42d6-a8ba-a29f7c9d02b7 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:25.901194 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-db4a054f-5e45-42d6-a8ba-a29f7c9d02b7 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:33:25.909733 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-db4a054f-5e45-42d6-a8ba-a29f7c9d02b7 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.138214 Apr 30 13:33:25.910321 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 906/1703] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:33:25 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:33:26.926609 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-c38c19c2-bfea-4568-9eb7-aa2a76ecb44f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:33:26.927225 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-c38c19c2-bfea-4568-9eb7-aa2a76ecb44f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:33:26.934543 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c38c19c2-bfea-4568-9eb7-aa2a76ecb44f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:26.935050 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c38c19c2-bfea-4568-9eb7-aa2a76ecb44f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:26.935832 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c38c19c2-bfea-4568-9eb7-aa2a76ecb44f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:26.936262 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c38c19c2-bfea-4568-9eb7-aa2a76ecb44f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:27.047606 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-c38c19c2-bfea-4568-9eb7-aa2a76ecb44f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:33:27.056140 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-c38c19c2-bfea-4568-9eb7-aa2a76ecb44f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.133194 Apr 30 13:33:27.056696 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 798/1704] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:33:26 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:33:28.072444 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-1be77cae-6237-4384-9326-8c5744e25a70 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:33:28.073052 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-1be77cae-6237-4384-9326-8c5744e25a70 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:33:28.080375 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1be77cae-6237-4384-9326-8c5744e25a70 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:28.080822 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1be77cae-6237-4384-9326-8c5744e25a70 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:28.081589 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1be77cae-6237-4384-9326-8c5744e25a70 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:28.082045 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1be77cae-6237-4384-9326-8c5744e25a70 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:28.192525 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-1be77cae-6237-4384-9326-8c5744e25a70 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:33:28.201362 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-1be77cae-6237-4384-9326-8c5744e25a70 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.132854 Apr 30 13:33:28.201922 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 907/1705] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:33:28 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:33:29.217809 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-ba3f1a8f-22e4-4890-9566-6871a67b41ac tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:33:29.218459 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-ba3f1a8f-22e4-4890-9566-6871a67b41ac tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:33:29.225714 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ba3f1a8f-22e4-4890-9566-6871a67b41ac tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:29.226202 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ba3f1a8f-22e4-4890-9566-6871a67b41ac tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:29.226974 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ba3f1a8f-22e4-4890-9566-6871a67b41ac tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:29.227405 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ba3f1a8f-22e4-4890-9566-6871a67b41ac tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:29.343103 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-ba3f1a8f-22e4-4890-9566-6871a67b41ac tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:33:29.351734 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-ba3f1a8f-22e4-4890-9566-6871a67b41ac tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.137696 Apr 30 13:33:29.353035 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 799/1706] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:33:29 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:33:30.369603 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b4e7fe1f-f02c-45de-a443-78a2e8877e0c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:33:30.370536 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-b4e7fe1f-f02c-45de-a443-78a2e8877e0c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:33:30.378216 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b4e7fe1f-f02c-45de-a443-78a2e8877e0c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:30.378665 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b4e7fe1f-f02c-45de-a443-78a2e8877e0c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:30.379440 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b4e7fe1f-f02c-45de-a443-78a2e8877e0c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:30.379879 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b4e7fe1f-f02c-45de-a443-78a2e8877e0c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:30.493989 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-b4e7fe1f-f02c-45de-a443-78a2e8877e0c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:33:30.502681 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b4e7fe1f-f02c-45de-a443-78a2e8877e0c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.137525 Apr 30 13:33:30.503257 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 908/1707] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:33:30 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:33:31.520798 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-5b318e1b-cbba-43c8-8d62-fefffff63020 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:33:31.521413 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-5b318e1b-cbba-43c8-8d62-fefffff63020 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:33:31.528732 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5b318e1b-cbba-43c8-8d62-fefffff63020 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:31.529183 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5b318e1b-cbba-43c8-8d62-fefffff63020 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:31.529957 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5b318e1b-cbba-43c8-8d62-fefffff63020 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:31.530421 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5b318e1b-cbba-43c8-8d62-fefffff63020 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:31.648210 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-5b318e1b-cbba-43c8-8d62-fefffff63020 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:33:31.654564 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-5b318e1b-cbba-43c8-8d62-fefffff63020 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.138347 Apr 30 13:33:31.655137 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 800/1708] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:33:31 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:33:32.672925 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-8f3a01c4-f8fa-4e06-83c0-16b04a230a26 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:33:32.673693 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-8f3a01c4-f8fa-4e06-83c0-16b04a230a26 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:33:32.682659 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8f3a01c4-f8fa-4e06-83c0-16b04a230a26 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:32.683192 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8f3a01c4-f8fa-4e06-83c0-16b04a230a26 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:32.684210 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8f3a01c4-f8fa-4e06-83c0-16b04a230a26 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:32.684660 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8f3a01c4-f8fa-4e06-83c0-16b04a230a26 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:32.827053 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-8f3a01c4-f8fa-4e06-83c0-16b04a230a26 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:33:32.836583 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-8f3a01c4-f8fa-4e06-83c0-16b04a230a26 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.167386 Apr 30 13:33:32.843592 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 909/1709] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:33:32 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:33:33.853247 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-b360b14c-a9ae-41c1-9c21-8d7cb5214a8f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:33:33.854513 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-b360b14c-a9ae-41c1-9c21-8d7cb5214a8f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:33:33.862046 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b360b14c-a9ae-41c1-9c21-8d7cb5214a8f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:33.862509 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b360b14c-a9ae-41c1-9c21-8d7cb5214a8f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:33.863366 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b360b14c-a9ae-41c1-9c21-8d7cb5214a8f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:33.863880 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b360b14c-a9ae-41c1-9c21-8d7cb5214a8f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:33.979544 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-b360b14c-a9ae-41c1-9c21-8d7cb5214a8f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:33:33.988399 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-b360b14c-a9ae-41c1-9c21-8d7cb5214a8f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.139331 Apr 30 13:33:33.988957 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 801/1710] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:33:33 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:33:35.002338 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb5a7899-1fdb-42b6-bec0-d69e54b8f5a6] AMQP server on 10.222.0.79:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 13:33:35.005680 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-f6d382ad-c3da-44c2-bda8-dc4ec367bbc9 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:33:35.006438 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-f6d382ad-c3da-44c2-bda8-dc4ec367bbc9 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:33:35.014640 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f6d382ad-c3da-44c2-bda8-dc4ec367bbc9 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:35.015101 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f6d382ad-c3da-44c2-bda8-dc4ec367bbc9 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:35.015893 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f6d382ad-c3da-44c2-bda8-dc4ec367bbc9 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:35.016512 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f6d382ad-c3da-44c2-bda8-dc4ec367bbc9 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:35.136910 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-f6d382ad-c3da-44c2-bda8-dc4ec367bbc9 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:33:35.145503 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-f6d382ad-c3da-44c2-bda8-dc4ec367bbc9 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.144627 Apr 30 13:33:35.146091 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 910/1711] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:33:34 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:33:36.162451 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-b5b49d4d-110d-493a-b3a6-afdb7fff7d07 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:33:36.162994 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-b5b49d4d-110d-493a-b3a6-afdb7fff7d07 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:33:36.170263 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b5b49d4d-110d-493a-b3a6-afdb7fff7d07 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:36.170743 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b5b49d4d-110d-493a-b3a6-afdb7fff7d07 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:36.171573 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b5b49d4d-110d-493a-b3a6-afdb7fff7d07 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:36.172054 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b5b49d4d-110d-493a-b3a6-afdb7fff7d07 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:36.290949 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-b5b49d4d-110d-493a-b3a6-afdb7fff7d07 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:33:36.299590 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-b5b49d4d-110d-493a-b3a6-afdb7fff7d07 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.141269 Apr 30 13:33:36.300167 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 802/1712] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:33:36 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:33:37.315876 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-9a9b64c2-2204-45c5-91bf-5bbff9ba66dc tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:33:37.316488 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-9a9b64c2-2204-45c5-91bf-5bbff9ba66dc tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:33:37.334510 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9a9b64c2-2204-45c5-91bf-5bbff9ba66dc tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:37.334962 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9a9b64c2-2204-45c5-91bf-5bbff9ba66dc tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:37.335742 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9a9b64c2-2204-45c5-91bf-5bbff9ba66dc tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:37.336762 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9a9b64c2-2204-45c5-91bf-5bbff9ba66dc tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:37.370743 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb5a7899-1fdb-42b6-bec0-d69e54b8f5a6] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 33926. Apr 30 13:33:37.450778 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-9a9b64c2-2204-45c5-91bf-5bbff9ba66dc tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:33:37.459571 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-9a9b64c2-2204-45c5-91bf-5bbff9ba66dc tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.147406 Apr 30 13:33:37.460143 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 911/1713] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:33:37 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:33:38.476523 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-2d62a878-280f-451a-a936-979657771a3d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:33:38.477152 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-2d62a878-280f-451a-a936-979657771a3d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:33:38.484728 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2d62a878-280f-451a-a936-979657771a3d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:38.485183 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2d62a878-280f-451a-a936-979657771a3d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:38.485995 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2d62a878-280f-451a-a936-979657771a3d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:38.486467 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2d62a878-280f-451a-a936-979657771a3d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:38.599674 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-2d62a878-280f-451a-a936-979657771a3d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:33:38.608876 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-2d62a878-280f-451a-a936-979657771a3d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.136083 Apr 30 13:33:38.609452 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 803/1714] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:33:38 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:33:39.625766 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-e82e9368-00ba-4058-98fc-0e896be4f186 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:33:39.626347 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-e82e9368-00ba-4058-98fc-0e896be4f186 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:33:39.633663 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e82e9368-00ba-4058-98fc-0e896be4f186 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:39.634170 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e82e9368-00ba-4058-98fc-0e896be4f186 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:39.635646 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e82e9368-00ba-4058-98fc-0e896be4f186 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:39.636099 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e82e9368-00ba-4058-98fc-0e896be4f186 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:39.752175 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-e82e9368-00ba-4058-98fc-0e896be4f186 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:33:39.761087 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-e82e9368-00ba-4058-98fc-0e896be4f186 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.139137 Apr 30 13:33:39.761662 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 912/1715] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:33:39 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:33:40.777677 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-00d4fe3d-8f25-4812-92e5-0c59ee1df9bc tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:33:40.778332 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-00d4fe3d-8f25-4812-92e5-0c59ee1df9bc tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:33:40.785527 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-00d4fe3d-8f25-4812-92e5-0c59ee1df9bc tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:40.785980 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-00d4fe3d-8f25-4812-92e5-0c59ee1df9bc tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:40.787042 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-00d4fe3d-8f25-4812-92e5-0c59ee1df9bc tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:40.787483 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-00d4fe3d-8f25-4812-92e5-0c59ee1df9bc tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:40.902966 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-00d4fe3d-8f25-4812-92e5-0c59ee1df9bc tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:33:40.911883 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-00d4fe3d-8f25-4812-92e5-0c59ee1df9bc tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.138620 Apr 30 13:33:40.912448 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 804/1716] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:33:40 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:33:41.927987 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-d54af93f-e95e-4132-8074-a014befe4240 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:33:41.928606 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-d54af93f-e95e-4132-8074-a014befe4240 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:33:41.936686 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d54af93f-e95e-4132-8074-a014befe4240 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:41.937135 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d54af93f-e95e-4132-8074-a014befe4240 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:41.937921 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d54af93f-e95e-4132-8074-a014befe4240 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:41.938386 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d54af93f-e95e-4132-8074-a014befe4240 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:42.053016 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-d54af93f-e95e-4132-8074-a014befe4240 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:33:42.062203 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-d54af93f-e95e-4132-8074-a014befe4240 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.137849 Apr 30 13:33:42.062699 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 913/1717] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:33:41 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:33:43.078535 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-6d79893e-94a3-4b55-a0cc-f982c75bc678 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:33:43.079153 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-6d79893e-94a3-4b55-a0cc-f982c75bc678 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:33:43.086504 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6d79893e-94a3-4b55-a0cc-f982c75bc678 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:43.086957 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6d79893e-94a3-4b55-a0cc-f982c75bc678 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:43.088407 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6d79893e-94a3-4b55-a0cc-f982c75bc678 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:43.088846 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6d79893e-94a3-4b55-a0cc-f982c75bc678 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:43.205420 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-6d79893e-94a3-4b55-a0cc-f982c75bc678 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:33:43.214473 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-6d79893e-94a3-4b55-a0cc-f982c75bc678 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.139617 Apr 30 13:33:43.215041 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 805/1718] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:33:43 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:33:44.231582 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-1c83d7ca-dd0e-411f-9f1a-c4d85131716c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:33:44.232195 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-1c83d7ca-dd0e-411f-9f1a-c4d85131716c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:33:44.239641 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1c83d7ca-dd0e-411f-9f1a-c4d85131716c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:44.240028 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1c83d7ca-dd0e-411f-9f1a-c4d85131716c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:44.240810 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1c83d7ca-dd0e-411f-9f1a-c4d85131716c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:44.241252 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1c83d7ca-dd0e-411f-9f1a-c4d85131716c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:44.357064 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-1c83d7ca-dd0e-411f-9f1a-c4d85131716c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:33:44.365818 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-1c83d7ca-dd0e-411f-9f1a-c4d85131716c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.138441 Apr 30 13:33:44.366403 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 914/1719] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:33:44 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:33:45.381891 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-b689174b-55e5-4f35-bf24-4f51e134358a tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:33:45.382478 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-b689174b-55e5-4f35-bf24-4f51e134358a tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:33:45.389966 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b689174b-55e5-4f35-bf24-4f51e134358a tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:45.390454 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b689174b-55e5-4f35-bf24-4f51e134358a tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:45.391230 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b689174b-55e5-4f35-bf24-4f51e134358a tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:45.391671 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b689174b-55e5-4f35-bf24-4f51e134358a tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:45.504342 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-b689174b-55e5-4f35-bf24-4f51e134358a tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:33:45.513077 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-b689174b-55e5-4f35-bf24-4f51e134358a tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.135013 Apr 30 13:33:45.513645 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 806/1720] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:33:45 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:33:46.529713 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-4a59fb09-c246-4132-8753-d66961fabc4c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:33:46.530365 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-4a59fb09-c246-4132-8753-d66961fabc4c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:33:46.537931 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4a59fb09-c246-4132-8753-d66961fabc4c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:46.538423 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4a59fb09-c246-4132-8753-d66961fabc4c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:46.539207 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4a59fb09-c246-4132-8753-d66961fabc4c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:46.539648 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4a59fb09-c246-4132-8753-d66961fabc4c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:46.653210 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-4a59fb09-c246-4132-8753-d66961fabc4c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:33:46.662061 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-4a59fb09-c246-4132-8753-d66961fabc4c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.136230 Apr 30 13:33:46.662628 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 915/1721] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:33:46 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:33:47.679123 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-349d48de-1734-4d42-9356-4f722b5b06cf tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:33:47.679750 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-349d48de-1734-4d42-9356-4f722b5b06cf tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:33:47.687939 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-349d48de-1734-4d42-9356-4f722b5b06cf tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:47.688391 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-349d48de-1734-4d42-9356-4f722b5b06cf tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:47.689176 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-349d48de-1734-4d42-9356-4f722b5b06cf tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:47.689623 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-349d48de-1734-4d42-9356-4f722b5b06cf tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:47.807899 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-349d48de-1734-4d42-9356-4f722b5b06cf tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:33:47.816818 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-349d48de-1734-4d42-9356-4f722b5b06cf tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.141433 Apr 30 13:33:47.817386 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 807/1722] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:33:47 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:33:48.834468 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-c2ba91b8-1c2e-4233-9181-2e71d260cde8 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:33:48.835075 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-c2ba91b8-1c2e-4233-9181-2e71d260cde8 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:33:48.843098 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c2ba91b8-1c2e-4233-9181-2e71d260cde8 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:48.843552 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c2ba91b8-1c2e-4233-9181-2e71d260cde8 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:48.844334 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c2ba91b8-1c2e-4233-9181-2e71d260cde8 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:48.844768 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c2ba91b8-1c2e-4233-9181-2e71d260cde8 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:48.958629 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-c2ba91b8-1c2e-4233-9181-2e71d260cde8 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:33:48.968008 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-c2ba91b8-1c2e-4233-9181-2e71d260cde8 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.137381 Apr 30 13:33:48.968698 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 916/1723] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:33:48 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:33:49.984997 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-58077aca-a4e6-4550-aeb3-a49ad2b22213 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:33:49.985608 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-58077aca-a4e6-4550-aeb3-a49ad2b22213 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:33:49.992944 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-58077aca-a4e6-4550-aeb3-a49ad2b22213 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:49.993392 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-58077aca-a4e6-4550-aeb3-a49ad2b22213 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:49.994229 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-58077aca-a4e6-4550-aeb3-a49ad2b22213 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:49.994674 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-58077aca-a4e6-4550-aeb3-a49ad2b22213 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:50.111231 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-58077aca-a4e6-4550-aeb3-a49ad2b22213 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:33:50.119879 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-58077aca-a4e6-4550-aeb3-a49ad2b22213 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.138492 Apr 30 13:33:50.120369 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 808/1724] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:33:49 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:33:51.136550 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-44a269c1-d572-48b9-aa57-5055e012d4ec tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:33:51.137098 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-44a269c1-d572-48b9-aa57-5055e012d4ec tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:33:51.144407 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-44a269c1-d572-48b9-aa57-5055e012d4ec tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:51.144857 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-44a269c1-d572-48b9-aa57-5055e012d4ec tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:51.145629 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-44a269c1-d572-48b9-aa57-5055e012d4ec tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:51.146096 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-44a269c1-d572-48b9-aa57-5055e012d4ec tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:51.258733 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-44a269c1-d572-48b9-aa57-5055e012d4ec tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:33:51.267386 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-44a269c1-d572-48b9-aa57-5055e012d4ec tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.134888 Apr 30 13:33:51.267947 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 917/1725] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:33:51 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:33:52.284499 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-9b8be40d-7781-42c9-8da7-b02238ea8e55 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:33:52.285166 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-9b8be40d-7781-42c9-8da7-b02238ea8e55 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:33:52.292880 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9b8be40d-7781-42c9-8da7-b02238ea8e55 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:52.293340 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9b8be40d-7781-42c9-8da7-b02238ea8e55 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:52.294149 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9b8be40d-7781-42c9-8da7-b02238ea8e55 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:52.294596 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9b8be40d-7781-42c9-8da7-b02238ea8e55 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:52.406251 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-9b8be40d-7781-42c9-8da7-b02238ea8e55 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:33:52.415305 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-9b8be40d-7781-42c9-8da7-b02238ea8e55 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.134544 Apr 30 13:33:52.415872 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 809/1726] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:33:52 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:33:53.432018 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-18a942b4-d8f4-4944-81bb-ab6677d2f649 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:33:53.432641 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-18a942b4-d8f4-4944-81bb-ab6677d2f649 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:33:53.439995 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-18a942b4-d8f4-4944-81bb-ab6677d2f649 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:53.440448 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-18a942b4-d8f4-4944-81bb-ab6677d2f649 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:53.441225 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-18a942b4-d8f4-4944-81bb-ab6677d2f649 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:53.441664 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-18a942b4-d8f4-4944-81bb-ab6677d2f649 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:53.557179 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-18a942b4-d8f4-4944-81bb-ab6677d2f649 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:33:53.565921 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-18a942b4-d8f4-4944-81bb-ab6677d2f649 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.137702 Apr 30 13:33:53.566523 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 918/1727] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:33:53 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:33:54.583101 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-657b334e-b4f1-4b07-921a-03793adc6b8c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:33:54.583818 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-657b334e-b4f1-4b07-921a-03793adc6b8c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:33:54.591859 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-657b334e-b4f1-4b07-921a-03793adc6b8c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:54.592314 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-657b334e-b4f1-4b07-921a-03793adc6b8c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:54.593103 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-657b334e-b4f1-4b07-921a-03793adc6b8c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:54.593544 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-657b334e-b4f1-4b07-921a-03793adc6b8c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:54.708048 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-657b334e-b4f1-4b07-921a-03793adc6b8c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:33:54.717601 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-657b334e-b4f1-4b07-921a-03793adc6b8c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.138225 Apr 30 13:33:54.718193 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 810/1728] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:33:54 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:33:55.735239 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-1469a1ac-77f4-40d2-9b49-0f90cc92993e tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:33:55.735868 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-1469a1ac-77f4-40d2-9b49-0f90cc92993e tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:33:55.743326 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1469a1ac-77f4-40d2-9b49-0f90cc92993e tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:55.743784 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1469a1ac-77f4-40d2-9b49-0f90cc92993e tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:55.744661 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1469a1ac-77f4-40d2-9b49-0f90cc92993e tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:55.745328 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1469a1ac-77f4-40d2-9b49-0f90cc92993e tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:55.866368 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-1469a1ac-77f4-40d2-9b49-0f90cc92993e tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:33:55.876223 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-1469a1ac-77f4-40d2-9b49-0f90cc92993e tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.145159 Apr 30 13:33:55.876829 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 919/1729] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:33:55 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:33:56.895714 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-3239d439-c713-48a0-8ceb-e266e71443d4 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:33:56.896333 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-3239d439-c713-48a0-8ceb-e266e71443d4 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:33:56.904328 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3239d439-c713-48a0-8ceb-e266e71443d4 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:56.904784 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3239d439-c713-48a0-8ceb-e266e71443d4 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:56.905568 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3239d439-c713-48a0-8ceb-e266e71443d4 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:56.906029 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3239d439-c713-48a0-8ceb-e266e71443d4 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:57.023862 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-3239d439-c713-48a0-8ceb-e266e71443d4 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:33:57.033189 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-3239d439-c713-48a0-8ceb-e266e71443d4 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.141201 Apr 30 13:33:57.033748 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 811/1730] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:33:56 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:33:58.051065 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-7c24253a-93ea-4ab9-a94a-e035dc7df406 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:33:58.051683 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-7c24253a-93ea-4ab9-a94a-e035dc7df406 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:33:58.060360 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7c24253a-93ea-4ab9-a94a-e035dc7df406 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:58.060826 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7c24253a-93ea-4ab9-a94a-e035dc7df406 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:58.061615 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7c24253a-93ea-4ab9-a94a-e035dc7df406 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:58.062083 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7c24253a-93ea-4ab9-a94a-e035dc7df406 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:58.175005 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-7c24253a-93ea-4ab9-a94a-e035dc7df406 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:33:58.184273 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-7c24253a-93ea-4ab9-a94a-e035dc7df406 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.137144 Apr 30 13:33:58.185133 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 920/1731] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:33:58 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:33:59.201235 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-c8bc4212-af9e-47ef-93bc-17f5f1ca6638 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:33:59.201878 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-c8bc4212-af9e-47ef-93bc-17f5f1ca6638 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:33:59.209395 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c8bc4212-af9e-47ef-93bc-17f5f1ca6638 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:59.209846 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c8bc4212-af9e-47ef-93bc-17f5f1ca6638 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:59.210657 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c8bc4212-af9e-47ef-93bc-17f5f1ca6638 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:33:59.211094 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c8bc4212-af9e-47ef-93bc-17f5f1ca6638 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:33:59.423909 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-c8bc4212-af9e-47ef-93bc-17f5f1ca6638 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:33:59.434562 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-c8bc4212-af9e-47ef-93bc-17f5f1ca6638 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.237625 Apr 30 13:33:59.435143 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 812/1732] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:33:59 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:34:00.451896 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-12d27759-18de-4da9-b3cb-c6673ad21541 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:34:00.452513 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-12d27759-18de-4da9-b3cb-c6673ad21541 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:34:00.459732 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-12d27759-18de-4da9-b3cb-c6673ad21541 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:00.460184 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-12d27759-18de-4da9-b3cb-c6673ad21541 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:00.460969 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-12d27759-18de-4da9-b3cb-c6673ad21541 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:00.461411 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-12d27759-18de-4da9-b3cb-c6673ad21541 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:00.575898 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-12d27759-18de-4da9-b3cb-c6673ad21541 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:34:00.585093 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-12d27759-18de-4da9-b3cb-c6673ad21541 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.137553 Apr 30 13:34:00.585653 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 921/1733] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:34:00 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:34:01.600353 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-6219fcb5-de2f-4261-a17a-03cd768bdbff tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:34:01.600970 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-6219fcb5-de2f-4261-a17a-03cd768bdbff tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:34:01.608365 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6219fcb5-de2f-4261-a17a-03cd768bdbff tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:01.608833 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6219fcb5-de2f-4261-a17a-03cd768bdbff tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:01.609579 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6219fcb5-de2f-4261-a17a-03cd768bdbff tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:01.610034 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6219fcb5-de2f-4261-a17a-03cd768bdbff tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:01.722323 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-6219fcb5-de2f-4261-a17a-03cd768bdbff tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:34:01.730986 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-6219fcb5-de2f-4261-a17a-03cd768bdbff tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.134313 Apr 30 13:34:01.731551 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 813/1734] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:34:01 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:34:02.747549 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-71ea9586-3497-484d-ad71-d92c5e3fbaa1 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:34:02.748137 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-71ea9586-3497-484d-ad71-d92c5e3fbaa1 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:34:02.755486 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-71ea9586-3497-484d-ad71-d92c5e3fbaa1 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:02.755945 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-71ea9586-3497-484d-ad71-d92c5e3fbaa1 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:02.756731 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-71ea9586-3497-484d-ad71-d92c5e3fbaa1 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:02.757173 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-71ea9586-3497-484d-ad71-d92c5e3fbaa1 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:02.938717 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-71ea9586-3497-484d-ad71-d92c5e3fbaa1 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:34:02.947922 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-71ea9586-3497-484d-ad71-d92c5e3fbaa1 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.203740 Apr 30 13:34:02.948491 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 922/1735] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:34:02 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:34:03.963548 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-1841e0c6-c9d8-4903-878f-56223fca63c9 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:34:03.964168 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-1841e0c6-c9d8-4903-878f-56223fca63c9 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:34:03.971709 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1841e0c6-c9d8-4903-878f-56223fca63c9 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:03.972165 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1841e0c6-c9d8-4903-878f-56223fca63c9 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:03.972949 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1841e0c6-c9d8-4903-878f-56223fca63c9 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:03.973390 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1841e0c6-c9d8-4903-878f-56223fca63c9 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:04.087259 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-1841e0c6-c9d8-4903-878f-56223fca63c9 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:34:04.096592 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-1841e0c6-c9d8-4903-878f-56223fca63c9 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.136852 Apr 30 13:34:04.097165 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 814/1736] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:34:03 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:34:05.112974 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-3c345e59-f0f2-4261-b1ba-d1190311c437 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:34:05.113514 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-3c345e59-f0f2-4261-b1ba-d1190311c437 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:34:05.122384 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3c345e59-f0f2-4261-b1ba-d1190311c437 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:05.122834 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3c345e59-f0f2-4261-b1ba-d1190311c437 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:05.123620 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3c345e59-f0f2-4261-b1ba-d1190311c437 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:05.124078 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3c345e59-f0f2-4261-b1ba-d1190311c437 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:05.236936 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-3c345e59-f0f2-4261-b1ba-d1190311c437 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:34:05.246337 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-3c345e59-f0f2-4261-b1ba-d1190311c437 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.137085 Apr 30 13:34:05.246897 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 923/1737] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:34:05 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:34:06.263430 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-9b33f250-ed1f-4417-aa27-30b278384e7f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:34:06.264045 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-9b33f250-ed1f-4417-aa27-30b278384e7f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:34:06.271486 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9b33f250-ed1f-4417-aa27-30b278384e7f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:06.271936 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9b33f250-ed1f-4417-aa27-30b278384e7f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:06.272706 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9b33f250-ed1f-4417-aa27-30b278384e7f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:06.273143 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9b33f250-ed1f-4417-aa27-30b278384e7f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:06.388199 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-9b33f250-ed1f-4417-aa27-30b278384e7f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:34:06.396658 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-9b33f250-ed1f-4417-aa27-30b278384e7f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.137531 Apr 30 13:34:06.397209 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 815/1738] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:34:06 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:34:07.413294 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-1d2b6a9d-cf81-42e8-aa6a-67ca1b147495 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:34:07.413903 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-1d2b6a9d-cf81-42e8-aa6a-67ca1b147495 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:34:07.422106 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1d2b6a9d-cf81-42e8-aa6a-67ca1b147495 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:07.422560 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1d2b6a9d-cf81-42e8-aa6a-67ca1b147495 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:07.423330 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1d2b6a9d-cf81-42e8-aa6a-67ca1b147495 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:07.423765 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1d2b6a9d-cf81-42e8-aa6a-67ca1b147495 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:07.537961 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-1d2b6a9d-cf81-42e8-aa6a-67ca1b147495 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:34:07.546677 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-1d2b6a9d-cf81-42e8-aa6a-67ca1b147495 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.137403 Apr 30 13:34:07.547241 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 924/1739] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:34:07 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:34:08.563575 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-2c6df661-5b2b-4a3d-a9ab-f6d25d084535 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:34:08.564189 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-2c6df661-5b2b-4a3d-a9ab-f6d25d084535 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:34:08.571508 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2c6df661-5b2b-4a3d-a9ab-f6d25d084535 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:08.571954 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2c6df661-5b2b-4a3d-a9ab-f6d25d084535 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:08.572778 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2c6df661-5b2b-4a3d-a9ab-f6d25d084535 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:08.573208 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2c6df661-5b2b-4a3d-a9ab-f6d25d084535 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:08.685695 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-2c6df661-5b2b-4a3d-a9ab-f6d25d084535 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:34:08.694296 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-2c6df661-5b2b-4a3d-a9ab-f6d25d084535 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.134435 Apr 30 13:34:08.694856 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 816/1740] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:34:08 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:34:09.710928 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-6d07cca4-9932-454b-a176-090486b95e3a tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:34:09.711540 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-6d07cca4-9932-454b-a176-090486b95e3a tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:34:09.718922 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6d07cca4-9932-454b-a176-090486b95e3a tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:09.719372 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6d07cca4-9932-454b-a176-090486b95e3a tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:09.720143 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6d07cca4-9932-454b-a176-090486b95e3a tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:09.720578 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6d07cca4-9932-454b-a176-090486b95e3a tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:09.838710 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-6d07cca4-9932-454b-a176-090486b95e3a tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:34:09.847378 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-6d07cca4-9932-454b-a176-090486b95e3a tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.140193 Apr 30 13:34:09.847933 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 925/1741] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:34:09 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:34:10.864730 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-973bb8cb-4630-43f7-bf29-e1d71f245353 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:34:10.865422 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-973bb8cb-4630-43f7-bf29-e1d71f245353 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:34:10.872765 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-973bb8cb-4630-43f7-bf29-e1d71f245353 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:10.873158 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-973bb8cb-4630-43f7-bf29-e1d71f245353 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:10.873934 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-973bb8cb-4630-43f7-bf29-e1d71f245353 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:10.874403 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-973bb8cb-4630-43f7-bf29-e1d71f245353 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:10.989306 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-973bb8cb-4630-43f7-bf29-e1d71f245353 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:34:10.998279 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-973bb8cb-4630-43f7-bf29-e1d71f245353 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.137202 Apr 30 13:34:10.998859 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 817/1742] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:34:10 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:34:12.015471 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-93c508b4-90f1-4be8-8fbe-a7f67e8083de tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:34:12.016080 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-93c508b4-90f1-4be8-8fbe-a7f67e8083de tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:34:12.023376 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-93c508b4-90f1-4be8-8fbe-a7f67e8083de tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:12.023922 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-93c508b4-90f1-4be8-8fbe-a7f67e8083de tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:12.024696 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-93c508b4-90f1-4be8-8fbe-a7f67e8083de tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:12.025459 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-93c508b4-90f1-4be8-8fbe-a7f67e8083de tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:12.138172 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-93c508b4-90f1-4be8-8fbe-a7f67e8083de tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:34:12.146712 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-93c508b4-90f1-4be8-8fbe-a7f67e8083de tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.134996 Apr 30 13:34:12.147268 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 926/1743] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:34:12 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:34:13.163641 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-eb0e7493-03ad-4632-b129-d2df014c0243 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:34:13.164394 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-eb0e7493-03ad-4632-b129-d2df014c0243 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:34:13.172692 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-eb0e7493-03ad-4632-b129-d2df014c0243 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:13.173151 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-eb0e7493-03ad-4632-b129-d2df014c0243 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:13.173946 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-eb0e7493-03ad-4632-b129-d2df014c0243 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:13.174417 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-eb0e7493-03ad-4632-b129-d2df014c0243 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:13.290405 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-eb0e7493-03ad-4632-b129-d2df014c0243 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:34:13.299698 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-eb0e7493-03ad-4632-b129-d2df014c0243 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.140525 Apr 30 13:34:13.300262 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 818/1744] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:34:13 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:34:14.316372 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-cffd709c-da06-43a4-8742-ab2b4a03c3a2 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:34:14.316981 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-cffd709c-da06-43a4-8742-ab2b4a03c3a2 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:34:14.324333 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-cffd709c-da06-43a4-8742-ab2b4a03c3a2 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:14.324786 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-cffd709c-da06-43a4-8742-ab2b4a03c3a2 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:14.325551 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-cffd709c-da06-43a4-8742-ab2b4a03c3a2 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:14.325985 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-cffd709c-da06-43a4-8742-ab2b4a03c3a2 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:14.440108 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-cffd709c-da06-43a4-8742-ab2b4a03c3a2 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:34:14.448951 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-cffd709c-da06-43a4-8742-ab2b4a03c3a2 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.136265 Apr 30 13:34:14.449508 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 927/1745] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:34:14 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:34:15.465262 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-01bb756f-a316-40a5-8ade-79a5631dd19a tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:34:15.465918 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-01bb756f-a316-40a5-8ade-79a5631dd19a tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:34:15.473178 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-01bb756f-a316-40a5-8ade-79a5631dd19a tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:15.473631 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-01bb756f-a316-40a5-8ade-79a5631dd19a tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:15.474453 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-01bb756f-a316-40a5-8ade-79a5631dd19a tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:15.474894 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-01bb756f-a316-40a5-8ade-79a5631dd19a tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:15.586833 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-01bb756f-a316-40a5-8ade-79a5631dd19a tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:34:15.595791 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-01bb756f-a316-40a5-8ade-79a5631dd19a tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.134593 Apr 30 13:34:15.596381 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 819/1746] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:34:15 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:34:16.612432 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-818736a2-e615-4e75-8824-cc5c5f6f2cfc tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:34:16.613055 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-818736a2-e615-4e75-8824-cc5c5f6f2cfc tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:34:16.621002 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-818736a2-e615-4e75-8824-cc5c5f6f2cfc tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:16.621453 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-818736a2-e615-4e75-8824-cc5c5f6f2cfc tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:16.622273 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-818736a2-e615-4e75-8824-cc5c5f6f2cfc tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:16.622725 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-818736a2-e615-4e75-8824-cc5c5f6f2cfc tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:16.739507 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-818736a2-e615-4e75-8824-cc5c5f6f2cfc tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:34:16.748926 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-818736a2-e615-4e75-8824-cc5c5f6f2cfc tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.140255 Apr 30 13:34:16.749672 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 928/1747] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:34:16 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:34:17.765882 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-2491812e-bf00-48fc-9289-3ab5efa0dde9 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:34:17.766437 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-2491812e-bf00-48fc-9289-3ab5efa0dde9 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:34:17.773561 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2491812e-bf00-48fc-9289-3ab5efa0dde9 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:17.774025 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2491812e-bf00-48fc-9289-3ab5efa0dde9 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:17.774809 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2491812e-bf00-48fc-9289-3ab5efa0dde9 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:17.775250 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2491812e-bf00-48fc-9289-3ab5efa0dde9 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:17.898831 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-2491812e-bf00-48fc-9289-3ab5efa0dde9 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:34:17.907704 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-2491812e-bf00-48fc-9289-3ab5efa0dde9 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.145502 Apr 30 13:34:17.908268 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 820/1748] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:34:17 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:34:18.924387 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-4d75b3f3-caaf-4dde-b380-98320c17cb48 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:34:18.925018 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-4d75b3f3-caaf-4dde-b380-98320c17cb48 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:34:18.932405 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4d75b3f3-caaf-4dde-b380-98320c17cb48 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:18.932864 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4d75b3f3-caaf-4dde-b380-98320c17cb48 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:18.933653 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4d75b3f3-caaf-4dde-b380-98320c17cb48 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:18.934310 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4d75b3f3-caaf-4dde-b380-98320c17cb48 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:19.049013 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-4d75b3f3-caaf-4dde-b380-98320c17cb48 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:34:19.058367 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-4d75b3f3-caaf-4dde-b380-98320c17cb48 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.137704 Apr 30 13:34:19.058935 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 929/1749] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:34:18 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:34:20.244999 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-a021178a-e97d-4355-9e61-d4c92f959665 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:34:20.245865 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-a021178a-e97d-4355-9e61-d4c92f959665 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:34:20.253180 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a021178a-e97d-4355-9e61-d4c92f959665 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:20.253638 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a021178a-e97d-4355-9e61-d4c92f959665 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:20.254520 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a021178a-e97d-4355-9e61-d4c92f959665 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:20.254966 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a021178a-e97d-4355-9e61-d4c92f959665 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:20.369744 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-a021178a-e97d-4355-9e61-d4c92f959665 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:34:20.378685 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-a021178a-e97d-4355-9e61-d4c92f959665 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.307615 Apr 30 13:34:20.379243 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 821/1750] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:34:20 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:34:21.395878 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-913884a8-2d21-452d-9683-1df8b3fe10c4 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:34:21.396415 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-913884a8-2d21-452d-9683-1df8b3fe10c4 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:34:21.404308 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-913884a8-2d21-452d-9683-1df8b3fe10c4 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:21.404754 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-913884a8-2d21-452d-9683-1df8b3fe10c4 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:21.405527 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-913884a8-2d21-452d-9683-1df8b3fe10c4 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:21.405969 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-913884a8-2d21-452d-9683-1df8b3fe10c4 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:21.519370 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-913884a8-2d21-452d-9683-1df8b3fe10c4 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:34:21.528898 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-913884a8-2d21-452d-9683-1df8b3fe10c4 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.136852 Apr 30 13:34:21.529453 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 930/1751] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:34:21 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:34:22.546538 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-cf76b093-f27e-4f55-9902-473d82fde4e8 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:34:22.547169 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-cf76b093-f27e-4f55-9902-473d82fde4e8 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:34:22.554553 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cf76b093-f27e-4f55-9902-473d82fde4e8 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:22.555010 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cf76b093-f27e-4f55-9902-473d82fde4e8 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:22.555805 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cf76b093-f27e-4f55-9902-473d82fde4e8 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:22.556251 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cf76b093-f27e-4f55-9902-473d82fde4e8 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:22.667700 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-cf76b093-f27e-4f55-9902-473d82fde4e8 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:34:22.676462 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-cf76b093-f27e-4f55-9902-473d82fde4e8 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.134506 Apr 30 13:34:22.677032 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 822/1752] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:34:22 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:34:23.693347 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-a1f772b2-0554-40c3-89dd-fe5dff720d60 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:34:23.693965 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-a1f772b2-0554-40c3-89dd-fe5dff720d60 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:34:23.701950 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a1f772b2-0554-40c3-89dd-fe5dff720d60 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:23.702439 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a1f772b2-0554-40c3-89dd-fe5dff720d60 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:23.703222 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a1f772b2-0554-40c3-89dd-fe5dff720d60 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:23.703666 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a1f772b2-0554-40c3-89dd-fe5dff720d60 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:23.818180 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-a1f772b2-0554-40c3-89dd-fe5dff720d60 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:34:23.827549 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-a1f772b2-0554-40c3-89dd-fe5dff720d60 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.137977 Apr 30 13:34:23.828121 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 931/1753] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:34:23 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:34:24.844607 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-35934690-a127-44aa-a472-0261a6fded5f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:34:24.845228 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-35934690-a127-44aa-a472-0261a6fded5f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:34:24.852597 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-35934690-a127-44aa-a472-0261a6fded5f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:24.853056 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-35934690-a127-44aa-a472-0261a6fded5f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:24.853849 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-35934690-a127-44aa-a472-0261a6fded5f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:24.854319 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-35934690-a127-44aa-a472-0261a6fded5f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:24.967537 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-35934690-a127-44aa-a472-0261a6fded5f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:34:24.976163 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-35934690-a127-44aa-a472-0261a6fded5f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.135321 Apr 30 13:34:24.976721 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 823/1754] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:34:24 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:34:25.992187 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-3ac84d9d-e5f8-4211-90f1-d436ea7e2297 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:34:25.992804 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-3ac84d9d-e5f8-4211-90f1-d436ea7e2297 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:34:26.000318 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3ac84d9d-e5f8-4211-90f1-d436ea7e2297 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:26.000777 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3ac84d9d-e5f8-4211-90f1-d436ea7e2297 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:26.001555 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3ac84d9d-e5f8-4211-90f1-d436ea7e2297 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:26.001997 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3ac84d9d-e5f8-4211-90f1-d436ea7e2297 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:26.113357 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-3ac84d9d-e5f8-4211-90f1-d436ea7e2297 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:34:26.121965 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-3ac84d9d-e5f8-4211-90f1-d436ea7e2297 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.133450 Apr 30 13:34:26.122502 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 932/1755] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:34:25 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:34:27.139244 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-e0e3a83b-deed-4fb0-8d58-ad5dc3571039 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:34:27.139791 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-e0e3a83b-deed-4fb0-8d58-ad5dc3571039 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:34:27.147110 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e0e3a83b-deed-4fb0-8d58-ad5dc3571039 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:27.147570 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e0e3a83b-deed-4fb0-8d58-ad5dc3571039 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:27.148354 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e0e3a83b-deed-4fb0-8d58-ad5dc3571039 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:27.148798 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e0e3a83b-deed-4fb0-8d58-ad5dc3571039 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:27.263637 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-e0e3a83b-deed-4fb0-8d58-ad5dc3571039 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:34:27.272270 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-e0e3a83b-deed-4fb0-8d58-ad5dc3571039 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.137450 Apr 30 13:34:27.272842 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 824/1756] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:34:27 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:34:28.289494 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-525aca4d-1a82-4fef-98c5-e1570c9e2749 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:34:28.290160 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-525aca4d-1a82-4fef-98c5-e1570c9e2749 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:34:28.297570 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-525aca4d-1a82-4fef-98c5-e1570c9e2749 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:28.298050 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-525aca4d-1a82-4fef-98c5-e1570c9e2749 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:28.298873 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-525aca4d-1a82-4fef-98c5-e1570c9e2749 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:28.299319 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-525aca4d-1a82-4fef-98c5-e1570c9e2749 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:28.413842 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-525aca4d-1a82-4fef-98c5-e1570c9e2749 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:34:28.423749 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-525aca4d-1a82-4fef-98c5-e1570c9e2749 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.138281 Apr 30 13:34:28.424428 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 933/1757] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:34:28 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:34:29.439808 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-cd3e6b90-ef0b-461a-bdda-d669d9d262c1 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:34:29.440452 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-cd3e6b90-ef0b-461a-bdda-d669d9d262c1 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:34:29.447696 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cd3e6b90-ef0b-461a-bdda-d669d9d262c1 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:29.448144 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cd3e6b90-ef0b-461a-bdda-d669d9d262c1 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:29.449116 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cd3e6b90-ef0b-461a-bdda-d669d9d262c1 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:29.449553 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cd3e6b90-ef0b-461a-bdda-d669d9d262c1 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:29.564399 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-cd3e6b90-ef0b-461a-bdda-d669d9d262c1 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:34:29.573137 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-cd3e6b90-ef0b-461a-bdda-d669d9d262c1 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.137026 Apr 30 13:34:29.573829 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 825/1758] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:34:29 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:34:30.590329 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-9bee3fb3-6fb6-42af-8cd9-15a8f2ec8658 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:34:30.590953 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-9bee3fb3-6fb6-42af-8cd9-15a8f2ec8658 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:34:30.598383 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9bee3fb3-6fb6-42af-8cd9-15a8f2ec8658 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:30.598828 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9bee3fb3-6fb6-42af-8cd9-15a8f2ec8658 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:30.599618 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9bee3fb3-6fb6-42af-8cd9-15a8f2ec8658 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:30.600063 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9bee3fb3-6fb6-42af-8cd9-15a8f2ec8658 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:30.716963 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-9bee3fb3-6fb6-42af-8cd9-15a8f2ec8658 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:34:30.725669 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-9bee3fb3-6fb6-42af-8cd9-15a8f2ec8658 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.139675 Apr 30 13:34:30.726385 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 934/1759] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:34:30 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:34:31.742887 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-79b81b50-8afb-48df-81b7-fc5531d7d5b8 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:34:31.743513 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-79b81b50-8afb-48df-81b7-fc5531d7d5b8 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:34:31.751569 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-79b81b50-8afb-48df-81b7-fc5531d7d5b8 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:31.752020 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-79b81b50-8afb-48df-81b7-fc5531d7d5b8 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:31.752804 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-79b81b50-8afb-48df-81b7-fc5531d7d5b8 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:31.753311 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-79b81b50-8afb-48df-81b7-fc5531d7d5b8 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:31.867512 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-79b81b50-8afb-48df-81b7-fc5531d7d5b8 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:34:31.876459 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-79b81b50-8afb-48df-81b7-fc5531d7d5b8 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.137275 Apr 30 13:34:31.877019 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 826/1760] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:34:31 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:34:32.892937 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-c9e1541b-4f14-4403-adc1-75ca9f4e96e3 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:34:32.893487 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-c9e1541b-4f14-4403-adc1-75ca9f4e96e3 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:34:32.900814 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c9e1541b-4f14-4403-adc1-75ca9f4e96e3 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:32.901265 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c9e1541b-4f14-4403-adc1-75ca9f4e96e3 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:32.902148 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c9e1541b-4f14-4403-adc1-75ca9f4e96e3 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:32.902587 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c9e1541b-4f14-4403-adc1-75ca9f4e96e3 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:33.014192 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-c9e1541b-4f14-4403-adc1-75ca9f4e96e3 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:34:33.022759 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-c9e1541b-4f14-4403-adc1-75ca9f4e96e3 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.133646 Apr 30 13:34:33.023331 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 935/1761] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:34:32 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:34:34.039665 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-b9ba59da-c872-48d4-9a92-ab40b4428056 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:34:34.040288 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-b9ba59da-c872-48d4-9a92-ab40b4428056 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:34:34.047911 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b9ba59da-c872-48d4-9a92-ab40b4428056 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:34.048366 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b9ba59da-c872-48d4-9a92-ab40b4428056 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:34.049157 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b9ba59da-c872-48d4-9a92-ab40b4428056 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:34.049603 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b9ba59da-c872-48d4-9a92-ab40b4428056 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:34.165257 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-b9ba59da-c872-48d4-9a92-ab40b4428056 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:34:34.173993 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-b9ba59da-c872-48d4-9a92-ab40b4428056 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.138273 Apr 30 13:34:34.174576 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 827/1762] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:34:34 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:34:35.190932 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-ce155673-cc59-46a0-94a7-f4ebaa0cec2d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:34:35.191459 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-ce155673-cc59-46a0-94a7-f4ebaa0cec2d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:34:35.199498 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ce155673-cc59-46a0-94a7-f4ebaa0cec2d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:35.199951 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ce155673-cc59-46a0-94a7-f4ebaa0cec2d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:35.200761 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ce155673-cc59-46a0-94a7-f4ebaa0cec2d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:35.201381 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ce155673-cc59-46a0-94a7-f4ebaa0cec2d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:35.458829 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-ce155673-cc59-46a0-94a7-f4ebaa0cec2d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:34:35.467707 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-ce155673-cc59-46a0-94a7-f4ebaa0cec2d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.280585 Apr 30 13:34:35.468269 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 936/1763] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:34:35 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:34:36.484020 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-86abc750-f57a-48b3-8fbb-2d459ce466e0 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:34:36.484638 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-86abc750-f57a-48b3-8fbb-2d459ce466e0 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:34:36.492009 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-86abc750-f57a-48b3-8fbb-2d459ce466e0 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:36.492464 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-86abc750-f57a-48b3-8fbb-2d459ce466e0 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:36.493251 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-86abc750-f57a-48b3-8fbb-2d459ce466e0 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:36.493695 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-86abc750-f57a-48b3-8fbb-2d459ce466e0 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:36.607899 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-86abc750-f57a-48b3-8fbb-2d459ce466e0 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:34:36.616502 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-86abc750-f57a-48b3-8fbb-2d459ce466e0 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.136173 Apr 30 13:34:36.617062 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 828/1764] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:34:36 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:34:37.632504 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-6d0506ee-a2c8-4715-a8a6-af9a9957949a tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:34:37.633119 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-6d0506ee-a2c8-4715-a8a6-af9a9957949a tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:34:37.640939 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6d0506ee-a2c8-4715-a8a6-af9a9957949a tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:37.641391 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6d0506ee-a2c8-4715-a8a6-af9a9957949a tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:37.642209 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6d0506ee-a2c8-4715-a8a6-af9a9957949a tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:37.642646 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6d0506ee-a2c8-4715-a8a6-af9a9957949a tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:37.756356 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-6d0506ee-a2c8-4715-a8a6-af9a9957949a tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:34:37.765551 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-6d0506ee-a2c8-4715-a8a6-af9a9957949a tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.136891 Apr 30 13:34:37.766123 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 937/1765] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:34:37 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:34:38.782494 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-3e715e94-dcac-4271-bc03-0eff5a20de7c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:34:38.783109 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-3e715e94-dcac-4271-bc03-0eff5a20de7c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:34:38.790620 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3e715e94-dcac-4271-bc03-0eff5a20de7c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:38.791080 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3e715e94-dcac-4271-bc03-0eff5a20de7c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:38.791858 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3e715e94-dcac-4271-bc03-0eff5a20de7c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:38.792413 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3e715e94-dcac-4271-bc03-0eff5a20de7c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:38.906175 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-3e715e94-dcac-4271-bc03-0eff5a20de7c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:34:38.915128 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-3e715e94-dcac-4271-bc03-0eff5a20de7c tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.136347 Apr 30 13:34:38.915695 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 829/1766] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:34:38 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:34:39.932611 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-16d123bb-a627-417a-b59c-0b2bf3ffd355 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:34:39.933256 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-16d123bb-a627-417a-b59c-0b2bf3ffd355 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:34:39.940867 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-16d123bb-a627-417a-b59c-0b2bf3ffd355 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:39.941321 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-16d123bb-a627-417a-b59c-0b2bf3ffd355 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:39.942129 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-16d123bb-a627-417a-b59c-0b2bf3ffd355 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:39.942576 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-16d123bb-a627-417a-b59c-0b2bf3ffd355 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:40.056318 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-16d123bb-a627-417a-b59c-0b2bf3ffd355 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:34:40.065608 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-16d123bb-a627-417a-b59c-0b2bf3ffd355 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.136769 Apr 30 13:34:40.066192 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 938/1767] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:34:39 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:34:41.083270 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-b622849e-e31d-4627-9d63-31bcc15231e5 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:34:41.083896 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-b622849e-e31d-4627-9d63-31bcc15231e5 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:34:41.091927 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b622849e-e31d-4627-9d63-31bcc15231e5 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:41.092390 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b622849e-e31d-4627-9d63-31bcc15231e5 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:41.093182 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b622849e-e31d-4627-9d63-31bcc15231e5 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:41.093629 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b622849e-e31d-4627-9d63-31bcc15231e5 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:41.209139 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-b622849e-e31d-4627-9d63-31bcc15231e5 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:34:41.218347 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-b622849e-e31d-4627-9d63-31bcc15231e5 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.138785 Apr 30 13:34:41.218918 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 830/1768] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:34:41 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:34:42.233869 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-6aa0a759-b333-4ae7-b965-f31d7a438bff tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:34:42.234678 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-6aa0a759-b333-4ae7-b965-f31d7a438bff tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:34:42.242624 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6aa0a759-b333-4ae7-b965-f31d7a438bff tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:42.243072 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6aa0a759-b333-4ae7-b965-f31d7a438bff tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:42.243839 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6aa0a759-b333-4ae7-b965-f31d7a438bff tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:42.244282 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6aa0a759-b333-4ae7-b965-f31d7a438bff tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:42.358584 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-6aa0a759-b333-4ae7-b965-f31d7a438bff tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:34:42.367159 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-6aa0a759-b333-4ae7-b965-f31d7a438bff tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.137088 Apr 30 13:34:42.367715 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 939/1769] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:34:42 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:34:43.384496 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-8be98c91-2fbd-4ae8-ab6e-311471c0daaf tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:34:43.385110 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-8be98c91-2fbd-4ae8-ab6e-311471c0daaf tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:34:43.393067 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8be98c91-2fbd-4ae8-ab6e-311471c0daaf tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:43.393518 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8be98c91-2fbd-4ae8-ab6e-311471c0daaf tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:43.394325 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8be98c91-2fbd-4ae8-ab6e-311471c0daaf tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:43.394762 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8be98c91-2fbd-4ae8-ab6e-311471c0daaf tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:43.508390 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-8be98c91-2fbd-4ae8-ab6e-311471c0daaf tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:34:43.517918 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-8be98c91-2fbd-4ae8-ab6e-311471c0daaf tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.137162 Apr 30 13:34:43.518498 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 831/1770] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:34:43 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:34:44.534713 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-db4feeac-5fd8-45d9-b1dd-fec4268cbcbf tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:34:44.535300 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-db4feeac-5fd8-45d9-b1dd-fec4268cbcbf tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:34:44.543845 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-db4feeac-5fd8-45d9-b1dd-fec4268cbcbf tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:44.544302 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-db4feeac-5fd8-45d9-b1dd-fec4268cbcbf tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:44.545083 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-db4feeac-5fd8-45d9-b1dd-fec4268cbcbf tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:44.545538 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-db4feeac-5fd8-45d9-b1dd-fec4268cbcbf tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:44.659001 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-db4feeac-5fd8-45d9-b1dd-fec4268cbcbf tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:34:44.667959 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-db4feeac-5fd8-45d9-b1dd-fec4268cbcbf tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.136970 Apr 30 13:34:44.669177 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 940/1771] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:34:44 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:34:45.685696 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-1239947f-d0a2-4749-a763-ee740cad3395 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:34:45.686327 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-1239947f-d0a2-4749-a763-ee740cad3395 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:34:45.693671 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1239947f-d0a2-4749-a763-ee740cad3395 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:45.694154 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1239947f-d0a2-4749-a763-ee740cad3395 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:45.694924 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1239947f-d0a2-4749-a763-ee740cad3395 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:45.695358 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1239947f-d0a2-4749-a763-ee740cad3395 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:45.809976 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-1239947f-d0a2-4749-a763-ee740cad3395 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:34:45.818674 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-1239947f-d0a2-4749-a763-ee740cad3395 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.137352 Apr 30 13:34:45.819518 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 832/1772] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:34:45 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:34:46.837408 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-78ed5628-ccd0-4f7a-939b-3ea451acd577 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:34:46.838133 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-78ed5628-ccd0-4f7a-939b-3ea451acd577 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:34:46.845866 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-78ed5628-ccd0-4f7a-939b-3ea451acd577 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:46.846359 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-78ed5628-ccd0-4f7a-939b-3ea451acd577 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:46.847147 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-78ed5628-ccd0-4f7a-939b-3ea451acd577 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:46.847772 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-78ed5628-ccd0-4f7a-939b-3ea451acd577 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:46.961943 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-78ed5628-ccd0-4f7a-939b-3ea451acd577 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:34:46.971264 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-78ed5628-ccd0-4f7a-939b-3ea451acd577 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.139001 Apr 30 13:34:46.971830 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 941/1773] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:34:46 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:34:47.987865 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-e60c557e-fbd5-4411-968a-40fc5079abd4 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:34:47.988487 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-e60c557e-fbd5-4411-968a-40fc5079abd4 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:34:47.995842 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e60c557e-fbd5-4411-968a-40fc5079abd4 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:47.996296 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e60c557e-fbd5-4411-968a-40fc5079abd4 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:47.997151 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e60c557e-fbd5-4411-968a-40fc5079abd4 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:47.997597 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e60c557e-fbd5-4411-968a-40fc5079abd4 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:48.114370 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-e60c557e-fbd5-4411-968a-40fc5079abd4 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:34:48.123300 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-e60c557e-fbd5-4411-968a-40fc5079abd4 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.139228 Apr 30 13:34:48.123877 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 833/1774] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:34:47 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:34:49.138857 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-6607963f-d48d-459b-a66f-99fc21773a41 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:34:49.139486 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-6607963f-d48d-459b-a66f-99fc21773a41 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:34:49.147401 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6607963f-d48d-459b-a66f-99fc21773a41 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:49.147953 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6607963f-d48d-459b-a66f-99fc21773a41 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:49.149041 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6607963f-d48d-459b-a66f-99fc21773a41 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:49.149635 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6607963f-d48d-459b-a66f-99fc21773a41 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:49.268510 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-6607963f-d48d-459b-a66f-99fc21773a41 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:34:49.277199 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-6607963f-d48d-459b-a66f-99fc21773a41 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.142199 Apr 30 13:34:49.277769 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 942/1775] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:34:49 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:34:50.294996 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-dd8c26bb-b1de-465a-87a5-e54582fcd1f8 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:34:50.295618 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-dd8c26bb-b1de-465a-87a5-e54582fcd1f8 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:34:50.303002 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-dd8c26bb-b1de-465a-87a5-e54582fcd1f8 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:50.303459 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-dd8c26bb-b1de-465a-87a5-e54582fcd1f8 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:50.304245 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-dd8c26bb-b1de-465a-87a5-e54582fcd1f8 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:50.304687 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-dd8c26bb-b1de-465a-87a5-e54582fcd1f8 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:50.415794 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-dd8c26bb-b1de-465a-87a5-e54582fcd1f8 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:34:50.425051 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-dd8c26bb-b1de-465a-87a5-e54582fcd1f8 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.134283 Apr 30 13:34:50.425620 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 834/1776] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:34:50 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:34:51.442867 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-20421270-c663-49b6-b30f-16ca6d6f7950 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:34:51.443508 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-20421270-c663-49b6-b30f-16ca6d6f7950 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:34:51.451537 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-20421270-c663-49b6-b30f-16ca6d6f7950 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:51.451948 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-20421270-c663-49b6-b30f-16ca6d6f7950 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:51.452723 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-20421270-c663-49b6-b30f-16ca6d6f7950 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:51.453153 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-20421270-c663-49b6-b30f-16ca6d6f7950 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:51.566671 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-20421270-c663-49b6-b30f-16ca6d6f7950 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:34:51.576029 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-20421270-c663-49b6-b30f-16ca6d6f7950 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.136325 Apr 30 13:34:51.576569 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 943/1777] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:34:51 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:34:52.593151 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-8b0b31ee-e2b6-4faf-ae8b-4347bab79501 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:34:52.593773 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-8b0b31ee-e2b6-4faf-ae8b-4347bab79501 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:34:52.601031 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8b0b31ee-e2b6-4faf-ae8b-4347bab79501 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:52.601475 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8b0b31ee-e2b6-4faf-ae8b-4347bab79501 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:52.602276 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8b0b31ee-e2b6-4faf-ae8b-4347bab79501 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:52.602718 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8b0b31ee-e2b6-4faf-ae8b-4347bab79501 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:52.716587 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-8b0b31ee-e2b6-4faf-ae8b-4347bab79501 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:34:52.725146 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-8b0b31ee-e2b6-4faf-ae8b-4347bab79501 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.136431 Apr 30 13:34:52.725697 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 835/1778] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:34:52 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:34:53.741468 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-fec608b0-663b-4035-bc2c-2379f7380790 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:34:53.742132 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-fec608b0-663b-4035-bc2c-2379f7380790 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:34:53.749694 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-fec608b0-663b-4035-bc2c-2379f7380790 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:53.750173 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-fec608b0-663b-4035-bc2c-2379f7380790 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:53.750948 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-fec608b0-663b-4035-bc2c-2379f7380790 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:53.751383 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-fec608b0-663b-4035-bc2c-2379f7380790 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:53.865709 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-fec608b0-663b-4035-bc2c-2379f7380790 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:34:53.874785 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-fec608b0-663b-4035-bc2c-2379f7380790 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.136962 Apr 30 13:34:53.882050 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 944/1779] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:34:53 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:34:54.891473 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-9990767b-fd1f-410d-ad71-b9ad77312a4f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:34:54.892110 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-9990767b-fd1f-410d-ad71-b9ad77312a4f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:34:54.899723 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9990767b-fd1f-410d-ad71-b9ad77312a4f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:54.900180 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9990767b-fd1f-410d-ad71-b9ad77312a4f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:54.900972 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9990767b-fd1f-410d-ad71-b9ad77312a4f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:54.901412 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9990767b-fd1f-410d-ad71-b9ad77312a4f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:55.019668 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-9990767b-fd1f-410d-ad71-b9ad77312a4f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:34:55.028855 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-9990767b-fd1f-410d-ad71-b9ad77312a4f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.141123 Apr 30 13:34:55.029421 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 836/1780] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:34:54 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:34:56.045616 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-050648a8-ddf7-4383-b548-6fcbe9a4d7cb tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:34:56.046834 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-050648a8-ddf7-4383-b548-6fcbe9a4d7cb tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:34:56.055167 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-050648a8-ddf7-4383-b548-6fcbe9a4d7cb tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:56.055632 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-050648a8-ddf7-4383-b548-6fcbe9a4d7cb tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:56.056448 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-050648a8-ddf7-4383-b548-6fcbe9a4d7cb tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:56.056946 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-050648a8-ddf7-4383-b548-6fcbe9a4d7cb tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:56.174162 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-050648a8-ddf7-4383-b548-6fcbe9a4d7cb tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:34:56.182756 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-050648a8-ddf7-4383-b548-6fcbe9a4d7cb tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.140892 Apr 30 13:34:56.183394 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 945/1781] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:34:56 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:34:57.199612 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-383ce45e-9fce-4d7e-b0d7-2097088e5aeb tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:34:57.201016 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-383ce45e-9fce-4d7e-b0d7-2097088e5aeb tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:34:57.208571 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-383ce45e-9fce-4d7e-b0d7-2097088e5aeb tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:57.209021 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-383ce45e-9fce-4d7e-b0d7-2097088e5aeb tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:57.209826 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-383ce45e-9fce-4d7e-b0d7-2097088e5aeb tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:57.210294 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-383ce45e-9fce-4d7e-b0d7-2097088e5aeb tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:57.324559 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-383ce45e-9fce-4d7e-b0d7-2097088e5aeb tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:34:57.333858 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-383ce45e-9fce-4d7e-b0d7-2097088e5aeb tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.137914 Apr 30 13:34:57.334497 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 837/1782] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:34:57 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:34:58.350586 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-4acb2cbe-aca5-4a74-a332-541ed1163ffe tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:34:58.351323 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-4acb2cbe-aca5-4a74-a332-541ed1163ffe tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:34:58.358547 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4acb2cbe-aca5-4a74-a332-541ed1163ffe tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:58.359040 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4acb2cbe-aca5-4a74-a332-541ed1163ffe tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:58.359758 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4acb2cbe-aca5-4a74-a332-541ed1163ffe tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:58.360190 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4acb2cbe-aca5-4a74-a332-541ed1163ffe tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:58.475175 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-4acb2cbe-aca5-4a74-a332-541ed1163ffe tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:34:58.483954 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-4acb2cbe-aca5-4a74-a332-541ed1163ffe tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.137083 Apr 30 13:34:58.484508 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 946/1783] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:34:58 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:34:59.500676 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-1372f9e5-0dea-4ff7-af8b-ffc2b268d9d5 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:34:59.501304 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-1372f9e5-0dea-4ff7-af8b-ffc2b268d9d5 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:34:59.508695 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1372f9e5-0dea-4ff7-af8b-ffc2b268d9d5 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:59.509274 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1372f9e5-0dea-4ff7-af8b-ffc2b268d9d5 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:59.509938 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1372f9e5-0dea-4ff7-af8b-ffc2b268d9d5 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:34:59.510456 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1372f9e5-0dea-4ff7-af8b-ffc2b268d9d5 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:34:59.730468 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-1372f9e5-0dea-4ff7-af8b-ffc2b268d9d5 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:34:59.739401 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-1372f9e5-0dea-4ff7-af8b-ffc2b268d9d5 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.242698 Apr 30 13:34:59.739974 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 838/1784] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:34:59 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:35:00.756624 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b873ec08-5def-4c1b-963b-2ae5f8c09a33 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:35:00.757241 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-b873ec08-5def-4c1b-963b-2ae5f8c09a33 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:35:00.765174 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b873ec08-5def-4c1b-963b-2ae5f8c09a33 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:35:00.765627 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b873ec08-5def-4c1b-963b-2ae5f8c09a33 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:35:00.766434 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b873ec08-5def-4c1b-963b-2ae5f8c09a33 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:35:00.766875 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b873ec08-5def-4c1b-963b-2ae5f8c09a33 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:35:00.879539 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-b873ec08-5def-4c1b-963b-2ae5f8c09a33 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:35:00.888830 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b873ec08-5def-4c1b-963b-2ae5f8c09a33 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.135995 Apr 30 13:35:00.889377 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 947/1785] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:35:00 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:35:01.905293 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-ba417183-1cca-4677-8350-a9fdd6acbfc5 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:35:01.905909 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-ba417183-1cca-4677-8350-a9fdd6acbfc5 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:35:01.913422 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ba417183-1cca-4677-8350-a9fdd6acbfc5 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:35:01.913856 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ba417183-1cca-4677-8350-a9fdd6acbfc5 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:35:01.914673 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ba417183-1cca-4677-8350-a9fdd6acbfc5 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:35:01.915111 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ba417183-1cca-4677-8350-a9fdd6acbfc5 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:35:02.026949 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-ba417183-1cca-4677-8350-a9fdd6acbfc5 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:35:02.036964 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-ba417183-1cca-4677-8350-a9fdd6acbfc5 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.135483 Apr 30 13:35:02.037534 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 839/1786] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:35:01 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:35:02.717079 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:35:02.717556 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: Fri Apr 30 13:35:02 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:35:03.053467 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-c5b19c10-50b0-4a88-a60a-c129dd70e9c8 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:35:03.054106 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-c5b19c10-50b0-4a88-a60a-c129dd70e9c8 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:35:03.061869 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c5b19c10-50b0-4a88-a60a-c129dd70e9c8 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:35:03.062359 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c5b19c10-50b0-4a88-a60a-c129dd70e9c8 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:35:03.063138 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c5b19c10-50b0-4a88-a60a-c129dd70e9c8 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:35:03.063583 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c5b19c10-50b0-4a88-a60a-c129dd70e9c8 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:35:03.179423 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-c5b19c10-50b0-4a88-a60a-c129dd70e9c8 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:35:03.188014 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-c5b19c10-50b0-4a88-a60a-c129dd70e9c8 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.138368 Apr 30 13:35:03.188566 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 948/1787] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:35:03 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:35:04.204989 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-9d11dfee-a89d-40f5-ae8d-beca25c308ef tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:35:04.205607 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-9d11dfee-a89d-40f5-ae8d-beca25c308ef tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:35:04.212900 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9d11dfee-a89d-40f5-ae8d-beca25c308ef tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:35:04.213351 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9d11dfee-a89d-40f5-ae8d-beca25c308ef tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:35:04.214154 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9d11dfee-a89d-40f5-ae8d-beca25c308ef tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:35:04.214588 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9d11dfee-a89d-40f5-ae8d-beca25c308ef tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:35:04.331072 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-9d11dfee-a89d-40f5-ae8d-beca25c308ef tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:35:04.339887 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-9d11dfee-a89d-40f5-ae8d-beca25c308ef tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.138602 Apr 30 13:35:04.340462 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 840/1788] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:35:04 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:35:05.356925 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-95b809b8-839d-494f-a222-280f53414168 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:35:05.357546 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-95b809b8-839d-494f-a222-280f53414168 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:35:05.364863 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-95b809b8-839d-494f-a222-280f53414168 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:35:05.365318 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-95b809b8-839d-494f-a222-280f53414168 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:35:05.366122 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-95b809b8-839d-494f-a222-280f53414168 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:35:05.366569 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-95b809b8-839d-494f-a222-280f53414168 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:35:05.481516 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-95b809b8-839d-494f-a222-280f53414168 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:35:05.490135 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-95b809b8-839d-494f-a222-280f53414168 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.137517 Apr 30 13:35:05.490696 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 949/1789] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:35:05 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:35:06.506731 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-9528ddd8-52c8-4155-aca1-73e9a9348280 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:35:06.507355 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-9528ddd8-52c8-4155-aca1-73e9a9348280 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:35:06.515113 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9528ddd8-52c8-4155-aca1-73e9a9348280 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:35:06.515581 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9528ddd8-52c8-4155-aca1-73e9a9348280 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:35:06.516369 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9528ddd8-52c8-4155-aca1-73e9a9348280 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:35:06.516811 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9528ddd8-52c8-4155-aca1-73e9a9348280 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:35:06.631706 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-9528ddd8-52c8-4155-aca1-73e9a9348280 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:35:06.640877 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-9528ddd8-52c8-4155-aca1-73e9a9348280 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.137883 Apr 30 13:35:06.641464 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 841/1790] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:35:06 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:35:06.691483 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:35:06.691635 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: Fri Apr 30 13:35:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:35:07.657435 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-d823eaa9-d087-48fd-b40c-36072a2c9374 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:35:07.658085 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-d823eaa9-d087-48fd-b40c-36072a2c9374 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:35:07.665580 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d823eaa9-d087-48fd-b40c-36072a2c9374 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:35:07.666063 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d823eaa9-d087-48fd-b40c-36072a2c9374 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:35:07.666856 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d823eaa9-d087-48fd-b40c-36072a2c9374 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:35:07.667300 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d823eaa9-d087-48fd-b40c-36072a2c9374 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:35:07.781864 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-d823eaa9-d087-48fd-b40c-36072a2c9374 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:35:07.790705 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-d823eaa9-d087-48fd-b40c-36072a2c9374 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.137329 Apr 30 13:35:07.791261 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 950/1791] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:35:07 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:35:08.808097 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-c17e67df-5146-48f8-ab1f-495678d0971b tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:35:08.808723 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-c17e67df-5146-48f8-ab1f-495678d0971b tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:35:08.817036 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c17e67df-5146-48f8-ab1f-495678d0971b tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:35:08.817497 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c17e67df-5146-48f8-ab1f-495678d0971b tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:35:08.818317 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c17e67df-5146-48f8-ab1f-495678d0971b tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:35:08.818761 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c17e67df-5146-48f8-ab1f-495678d0971b tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:35:08.930813 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-c17e67df-5146-48f8-ab1f-495678d0971b tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:35:08.940198 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-c17e67df-5146-48f8-ab1f-495678d0971b tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.135896 Apr 30 13:35:08.940754 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 842/1792] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:35:08 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:35:09.956790 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-4badaab9-a0fa-4f50-9b07-7ed9a3229c3f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:35:09.957439 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-4badaab9-a0fa-4f50-9b07-7ed9a3229c3f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:35:09.964740 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4badaab9-a0fa-4f50-9b07-7ed9a3229c3f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:35:09.965741 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4badaab9-a0fa-4f50-9b07-7ed9a3229c3f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:35:09.966581 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4badaab9-a0fa-4f50-9b07-7ed9a3229c3f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:35:09.967017 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4badaab9-a0fa-4f50-9b07-7ed9a3229c3f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:35:10.080519 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-4badaab9-a0fa-4f50-9b07-7ed9a3229c3f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:35:10.089100 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-4badaab9-a0fa-4f50-9b07-7ed9a3229c3f tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.136136 Apr 30 13:35:10.089658 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 951/1793] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:35:09 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:35:11.107147 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-7a3e194e-9591-404b-8def-326ecf68f86d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:35:11.107800 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-7a3e194e-9591-404b-8def-326ecf68f86d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:35:11.115120 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7a3e194e-9591-404b-8def-326ecf68f86d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:35:11.115572 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7a3e194e-9591-404b-8def-326ecf68f86d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:35:11.116351 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7a3e194e-9591-404b-8def-326ecf68f86d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:35:11.116789 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-7a3e194e-9591-404b-8def-326ecf68f86d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:35:11.232415 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-7a3e194e-9591-404b-8def-326ecf68f86d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:35:11.240968 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-7a3e194e-9591-404b-8def-326ecf68f86d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.138028 Apr 30 13:35:11.241537 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 843/1794] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:35:11 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:35:12.258265 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-c04818c5-8ad1-4ae5-beec-b3f47c5a486d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:35:12.258889 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-c04818c5-8ad1-4ae5-beec-b3f47c5a486d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:35:12.267128 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c04818c5-8ad1-4ae5-beec-b3f47c5a486d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:35:12.267584 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c04818c5-8ad1-4ae5-beec-b3f47c5a486d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:35:12.268366 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c04818c5-8ad1-4ae5-beec-b3f47c5a486d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:35:12.268809 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c04818c5-8ad1-4ae5-beec-b3f47c5a486d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:35:12.382447 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-c04818c5-8ad1-4ae5-beec-b3f47c5a486d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:35:12.391861 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-c04818c5-8ad1-4ae5-beec-b3f47c5a486d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.137314 Apr 30 13:35:12.392417 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 952/1795] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:35:12 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:35:13.409984 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-e437bd4d-0118-441a-8500-3edc6ef641da tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:35:13.410565 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-e437bd4d-0118-441a-8500-3edc6ef641da tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:35:13.418140 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e437bd4d-0118-441a-8500-3edc6ef641da tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:35:13.418633 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e437bd4d-0118-441a-8500-3edc6ef641da tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:35:13.419402 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e437bd4d-0118-441a-8500-3edc6ef641da tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:35:13.419843 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e437bd4d-0118-441a-8500-3edc6ef641da tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:35:13.535437 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-e437bd4d-0118-441a-8500-3edc6ef641da tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:35:13.544668 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-e437bd4d-0118-441a-8500-3edc6ef641da tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.138465 Apr 30 13:35:13.545228 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 844/1796] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:35:13 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:35:14.561589 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-6c0336fb-de0e-4512-b569-86b5110b26fd tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:35:14.562211 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-6c0336fb-de0e-4512-b569-86b5110b26fd tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:35:14.569693 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6c0336fb-de0e-4512-b569-86b5110b26fd tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:35:14.570234 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6c0336fb-de0e-4512-b569-86b5110b26fd tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:35:14.571011 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6c0336fb-de0e-4512-b569-86b5110b26fd tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:35:14.571447 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6c0336fb-de0e-4512-b569-86b5110b26fd tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:35:14.685896 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-6c0336fb-de0e-4512-b569-86b5110b26fd tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:35:14.694735 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-6c0336fb-de0e-4512-b569-86b5110b26fd tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.137175 Apr 30 13:35:14.695333 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 953/1797] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:35:14 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:35:15.711446 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-521e3aa9-d317-42f8-8ac8-a813c4d17d64 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:35:15.712067 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-521e3aa9-d317-42f8-8ac8-a813c4d17d64 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:35:15.719328 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-521e3aa9-d317-42f8-8ac8-a813c4d17d64 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:35:15.719779 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-521e3aa9-d317-42f8-8ac8-a813c4d17d64 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:35:15.720561 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-521e3aa9-d317-42f8-8ac8-a813c4d17d64 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:35:15.721003 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-521e3aa9-d317-42f8-8ac8-a813c4d17d64 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:35:15.834892 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-521e3aa9-d317-42f8-8ac8-a813c4d17d64 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:35:15.844221 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-521e3aa9-d317-42f8-8ac8-a813c4d17d64 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.136436 Apr 30 13:35:15.844786 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 845/1798] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:35:15 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:35:16.860601 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-d32f6643-13eb-4d11-99f1-dd61a3e2aa25 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:35:16.861476 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-d32f6643-13eb-4d11-99f1-dd61a3e2aa25 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:35:16.869205 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d32f6643-13eb-4d11-99f1-dd61a3e2aa25 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:35:16.869916 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d32f6643-13eb-4d11-99f1-dd61a3e2aa25 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:35:16.870500 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d32f6643-13eb-4d11-99f1-dd61a3e2aa25 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:35:16.870947 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d32f6643-13eb-4d11-99f1-dd61a3e2aa25 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:35:16.988769 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-d32f6643-13eb-4d11-99f1-dd61a3e2aa25 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:35:16.997376 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-d32f6643-13eb-4d11-99f1-dd61a3e2aa25 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.140537 Apr 30 13:35:16.997928 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 954/1799] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:35:16 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:35:18.014256 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-b7ee1982-7f19-46c2-bf46-f6a1035ed5ec tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:35:18.014887 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-b7ee1982-7f19-46c2-bf46-f6a1035ed5ec tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:35:18.022239 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b7ee1982-7f19-46c2-bf46-f6a1035ed5ec tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:35:18.022696 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b7ee1982-7f19-46c2-bf46-f6a1035ed5ec tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:35:18.023479 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b7ee1982-7f19-46c2-bf46-f6a1035ed5ec tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:35:18.023923 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b7ee1982-7f19-46c2-bf46-f6a1035ed5ec tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:35:18.138455 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-b7ee1982-7f19-46c2-bf46-f6a1035ed5ec tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:35:18.147107 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-b7ee1982-7f19-46c2-bf46-f6a1035ed5ec tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.136891 Apr 30 13:35:18.147669 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 846/1800] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:35:18 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:35:19.164717 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-7b29f0a2-5cb5-4f3a-a268-3a0ff527612d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:35:19.165261 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-7b29f0a2-5cb5-4f3a-a268-3a0ff527612d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:35:19.172821 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7b29f0a2-5cb5-4f3a-a268-3a0ff527612d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:35:19.173278 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7b29f0a2-5cb5-4f3a-a268-3a0ff527612d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:35:19.174093 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7b29f0a2-5cb5-4f3a-a268-3a0ff527612d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:35:19.174540 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7b29f0a2-5cb5-4f3a-a268-3a0ff527612d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:35:19.363737 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-7b29f0a2-5cb5-4f3a-a268-3a0ff527612d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:35:19.372542 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-7b29f0a2-5cb5-4f3a-a268-3a0ff527612d tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.211923 Apr 30 13:35:19.373390 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 955/1801] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:35:19 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:35:20.389007 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-8604f871-cf41-47d5-ab39-872f48893647 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:35:20.389585 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-8604f871-cf41-47d5-ab39-872f48893647 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:35:20.396838 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8604f871-cf41-47d5-ab39-872f48893647 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:35:20.397284 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8604f871-cf41-47d5-ab39-872f48893647 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:35:20.398082 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8604f871-cf41-47d5-ab39-872f48893647 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:35:20.398522 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8604f871-cf41-47d5-ab39-872f48893647 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:35:20.514842 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-8604f871-cf41-47d5-ab39-872f48893647 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:35:20.523668 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-8604f871-cf41-47d5-ab39-872f48893647 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.138498 Apr 30 13:35:20.524242 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 847/1802] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:35:20 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:35:21.541057 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-47bdb95f-b1c9-4b02-91d7-ad99a53cbffe tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:35:21.541697 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-47bdb95f-b1c9-4b02-91d7-ad99a53cbffe tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:35:21.549669 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-47bdb95f-b1c9-4b02-91d7-ad99a53cbffe tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:35:21.550168 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-47bdb95f-b1c9-4b02-91d7-ad99a53cbffe tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:35:21.550951 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-47bdb95f-b1c9-4b02-91d7-ad99a53cbffe tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:35:21.551391 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-47bdb95f-b1c9-4b02-91d7-ad99a53cbffe tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:35:21.664473 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-47bdb95f-b1c9-4b02-91d7-ad99a53cbffe tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:35:21.674341 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-47bdb95f-b1c9-4b02-91d7-ad99a53cbffe tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1350 microversion: 2.1 time: 0.136988 Apr 30 13:35:21.674953 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 956/1803] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:35:21 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1350 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:35:22.485745 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:35:22.485906 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: Fri Apr 30 13:35:22 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:35:22.691369 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-8beab23b-a873-48b6-9770-c14d8cb0af72 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:35:22.692014 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-8beab23b-a873-48b6-9770-c14d8cb0af72 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:35:22.699403 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8beab23b-a873-48b6-9770-c14d8cb0af72 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:35:22.699855 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8beab23b-a873-48b6-9770-c14d8cb0af72 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:35:22.700631 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8beab23b-a873-48b6-9770-c14d8cb0af72 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:35:22.701073 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8beab23b-a873-48b6-9770-c14d8cb0af72 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:35:22.768924 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8beab23b-a873-48b6-9770-c14d8cb0af72 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:35:22.769291 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-8beab23b-a873-48b6-9770-c14d8cb0af72 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:35:22.769743 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.objects.instance [None req-8beab23b-a873-48b6-9770-c14d8cb0af72 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lazy-loading 'fault' on Instance uuid c4c66a3a-0046-442b-a6c9-54494d8a7722 {{(pid=87932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:35:22.825554 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-8beab23b-a873-48b6-9770-c14d8cb0af72 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e5f5b2ef3b243a5b503e95083c50449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '073a579db08449979c1fefb12078f6e9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:35:22.834931 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-8beab23b-a873-48b6-9770-c14d8cb0af72 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 200 len: 1444 microversion: 2.1 time: 0.147430 Apr 30 13:35:22.835500 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 848/1804] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:35:22 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 1444 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:35:23.852450 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-f1b852a0-774e-4437-b0f4-5f6724bc7e56 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:35:23.852963 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-f1b852a0-774e-4437-b0f4-5f6724bc7e56 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] [instance: c4c66a3a-0046-442b-a6c9-54494d8a7722] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:35:23.861104 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f1b852a0-774e-4437-b0f4-5f6724bc7e56 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:35:23.861551 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f1b852a0-774e-4437-b0f4-5f6724bc7e56 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:35:23.862383 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f1b852a0-774e-4437-b0f4-5f6724bc7e56 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:35:23.862817 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f1b852a0-774e-4437-b0f4-5f6724bc7e56 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:35:23.911568 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.wsgi [None req-f1b852a0-774e-4437-b0f4-5f6724bc7e56 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] HTTP exception thrown: Instance c4c66a3a-0046-442b-a6c9-54494d8a7722 could not be found. Apr 30 13:35:23.912179 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-f1b852a0-774e-4437-b0f4-5f6724bc7e56 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] Returning 404 to user: Instance c4c66a3a-0046-442b-a6c9-54494d8a7722 could not be found. {{(pid=87933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:35:23.913007 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-f1b852a0-774e-4437-b0f4-5f6724bc7e56 tempest-VolumesSnapshotTestJSON-90039925 tempest-VolumesSnapshotTestJSON-90039925-project] 10.222.0.79 "GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722" status: 404 len: 111 microversion: 2.1 time: 0.064406 Apr 30 13:35:23.913540 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 957/1805] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:35:23 2021] GET /compute/v2.1/servers/c4c66a3a-0046-442b-a6c9-54494d8a7722 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:35:27.433123 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:35:27.433677 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: Fri Apr 30 13:35:27 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:36:23.595402 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-3471a559-a38d-4ade-9e52-060712681b53 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:36:23.596066 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-3471a559-a38d-4ade-9e52-060712681b53 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:36:23.599845 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1abdcfbc-0fea-4857-8557-cdc275d2ef0c] AMQP server on 10.222.0.79:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 13:36:23.604790 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3471a559-a38d-4ade-9e52-060712681b53 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:36:23.605240 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3471a559-a38d-4ade-9e52-060712681b53 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:36:23.606030 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3471a559-a38d-4ade-9e52-060712681b53 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:36:23.606481 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3471a559-a38d-4ade-9e52-060712681b53 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:36:23.666938 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-3471a559-a38d-4ade-9e52-060712681b53 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Going to try to terminate instance {{(pid=87932) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 13:36:23.778687 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-3471a559-a38d-4ade-9e52-060712681b53 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021" status: 204 len: 0 microversion: 2.1 time: 0.186521 Apr 30 13:36:23.779186 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 849/1806] 10.222.0.79 () {58 vars in 1239 bytes} [Fri Apr 30 13:36:23 2021] DELETE /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 13:36:23.788687 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-debb7098-70a4-437d-b676-643a32e8288c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:36:23.789305 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-debb7098-70a4-437d-b676-643a32e8288c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:36:23.796658 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-debb7098-70a4-437d-b676-643a32e8288c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:36:23.797119 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-debb7098-70a4-437d-b676-643a32e8288c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:36:23.797917 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-debb7098-70a4-437d-b676-643a32e8288c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:36:23.798638 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-debb7098-70a4-437d-b676-643a32e8288c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:36:24.016665 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-debb7098-70a4-437d-b676-643a32e8288c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f2e072f58341ac85f9f856603b0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795985fdb0c545438436572c0f48ee24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:36:24.025824 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-debb7098-70a4-437d-b676-643a32e8288c tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "GET /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021" status: 200 len: 1675 microversion: 2.1 time: 0.242065 Apr 30 13:36:24.026418 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 958/1807] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:36:23 2021] GET /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021 => generated 1675 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:36:25.044217 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-3b51b0e3-0994-4ec4-9b6c-36af3d916b8f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:36:25.045300 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-3b51b0e3-0994-4ec4-9b6c-36af3d916b8f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:36:25.065751 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3b51b0e3-0994-4ec4-9b6c-36af3d916b8f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:36:25.066569 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3b51b0e3-0994-4ec4-9b6c-36af3d916b8f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:36:25.067676 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3b51b0e3-0994-4ec4-9b6c-36af3d916b8f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:36:25.068348 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-3b51b0e3-0994-4ec4-9b6c-36af3d916b8f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:36:25.267639 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO oslo.messaging._drivers.impl_rabbit [-] [1abdcfbc-0fea-4857-8557-cdc275d2ef0c] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 35188. Apr 30 13:36:25.378337 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-3b51b0e3-0994-4ec4-9b6c-36af3d916b8f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0f2e072f58341ac85f9f856603b0dc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795985fdb0c545438436572c0f48ee24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:36:25.386812 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-3b51b0e3-0994-4ec4-9b6c-36af3d916b8f tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "GET /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021" status: 200 len: 1607 microversion: 2.1 time: 0.346787 Apr 30 13:36:25.387380 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 850/1808] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:36:25 2021] GET /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021 => generated 1607 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:36:25.686846 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [req-e36e7bff-46e1-42e9-924b-140c7952c374 req-167cb757-d832-45f5-b6f2-5206aec044ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a50652a-d54a-4e55-a6cb-29c771123021", "name": "network-vif-deleted", "tag": "2cf19fd2-d682-4274-b4cd-7c382cab30e5"}]} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:36:25.688553 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:36:25.688553 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: warnings.warn(msg) Apr 30 13:36:25.698797 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-e36e7bff-46e1-42e9-924b-140c7952c374 req-167cb757-d832-45f5-b6f2-5206aec044ec service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:36:25.699310 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-e36e7bff-46e1-42e9-924b-140c7952c374 req-167cb757-d832-45f5-b6f2-5206aec044ec service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:36:25.719638 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.compute.server_external_events [req-e36e7bff-46e1-42e9-924b-140c7952c374 req-167cb757-d832-45f5-b6f2-5206aec044ec service nova] Creating event network-vif-deleted:2cf19fd2-d682-4274-b4cd-7c382cab30e5 for instance 3a50652a-d54a-4e55-a6cb-29c771123021 on hv-cinder-78836 Apr 30 13:36:25.725064 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [req-e36e7bff-46e1-42e9-924b-140c7952c374 req-167cb757-d832-45f5-b6f2-5206aec044ec service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041991 Apr 30 13:36:25.725656 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 959/1809] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:36:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:36:26.518551 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-aa929371-d1be-4cb3-8442-a3da284c36ff tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:36:26.519790 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-aa929371-d1be-4cb3-8442-a3da284c36ff tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:36:26.528949 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-aa929371-d1be-4cb3-8442-a3da284c36ff tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:36:26.529608 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-aa929371-d1be-4cb3-8442-a3da284c36ff tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:36:26.530460 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-aa929371-d1be-4cb3-8442-a3da284c36ff tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:36:26.530902 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-aa929371-d1be-4cb3-8442-a3da284c36ff tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:36:26.580707 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.wsgi [None req-aa929371-d1be-4cb3-8442-a3da284c36ff tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] HTTP exception thrown: Instance 3a50652a-d54a-4e55-a6cb-29c771123021 could not be found. Apr 30 13:36:26.581324 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-aa929371-d1be-4cb3-8442-a3da284c36ff tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Returning 404 to user: Instance 3a50652a-d54a-4e55-a6cb-29c771123021 could not be found. {{(pid=87932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:36:26.582185 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-aa929371-d1be-4cb3-8442-a3da284c36ff tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "GET /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021" status: 404 len: 111 microversion: 2.1 time: 0.181353 Apr 30 13:36:26.583408 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 851/1810] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:36:26 2021] GET /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021 => generated 111 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:36:26.592364 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-c3557724-3d09-4cf6-886a-3d0c72c0c57a tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Calling method '.version_select at 0x7f7500ce78b0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:36:26.626372 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-c3557724-3d09-4cf6-886a-3d0c72c0c57a tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1906955888" status: 202 len: 0 microversion: 2.1 time: 0.038025 Apr 30 13:36:26.627082 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 960/1811] 10.222.0.79 () {58 vars in 1221 bytes} [Fri Apr 30 13:36:26 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1906955888 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:36:44.068682 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-e1632f95-4776-4103-aa98-5dc80d08a61c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:36:44.069179 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-e1632f95-4776-4103-aa98-5dc80d08a61c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:36:44.076342 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e1632f95-4776-4103-aa98-5dc80d08a61c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:36:44.076789 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e1632f95-4776-4103-aa98-5dc80d08a61c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:36:44.077560 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e1632f95-4776-4103-aa98-5dc80d08a61c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:36:44.077997 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e1632f95-4776-4103-aa98-5dc80d08a61c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:36:44.140933 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-e1632f95-4776-4103-aa98-5dc80d08a61c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Going to try to terminate instance {{(pid=87932) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 13:36:44.255110 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-e1632f95-4776-4103-aa98-5dc80d08a61c tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "DELETE /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781" status: 204 len: 0 microversion: 2.20 time: 0.190450 Apr 30 13:36:44.256638 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 852/1812] 10.222.0.79 () {60 vars in 1280 bytes} [Fri Apr 30 13:36:44 2021] DELETE /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 30 13:36:44.262303 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb5a7899-1fdb-42b6-bec0-d69e54b8f5a6] AMQP server on 10.222.0.79:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 13:36:44.265649 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-8f269ffe-5e9b-4f87-96f6-205c6ab93383 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:36:44.266414 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-8f269ffe-5e9b-4f87-96f6-205c6ab93383 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:36:44.274314 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8f269ffe-5e9b-4f87-96f6-205c6ab93383 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:36:44.275033 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8f269ffe-5e9b-4f87-96f6-205c6ab93383 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:36:44.276048 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8f269ffe-5e9b-4f87-96f6-205c6ab93383 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:36:44.276752 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-8f269ffe-5e9b-4f87-96f6-205c6ab93383 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:36:44.578170 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-8f269ffe-5e9b-4f87-96f6-205c6ab93383 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:36:44.588023 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-8f269ffe-5e9b-4f87-96f6-205c6ab93383 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:36:44.589546 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-8f269ffe-5e9b-4f87-96f6-205c6ab93383 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:36:44.590747 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-8f269ffe-5e9b-4f87-96f6-205c6ab93383 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781" status: 200 len: 1720 microversion: 2.20 time: 0.329883 Apr 30 13:36:44.591303 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 961/1813] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:36:44 2021] GET /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781 => generated 1720 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 30 13:36:45.610179 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-88cfe61c-870c-4eb7-90c6-17bd4b98db2d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:36:45.610899 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-88cfe61c-870c-4eb7-90c6-17bd4b98db2d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:36:45.618836 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-88cfe61c-870c-4eb7-90c6-17bd4b98db2d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:36:45.619291 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-88cfe61c-870c-4eb7-90c6-17bd4b98db2d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:36:45.620098 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-88cfe61c-870c-4eb7-90c6-17bd4b98db2d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:36:45.620544 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-88cfe61c-870c-4eb7-90c6-17bd4b98db2d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:36:45.892330 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-88cfe61c-870c-4eb7-90c6-17bd4b98db2d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:36:45.901771 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-88cfe61c-870c-4eb7-90c6-17bd4b98db2d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:36:45.903306 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-88cfe61c-870c-4eb7-90c6-17bd4b98db2d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1014c3ed5ee9414b96f591b3b397a981', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '092cf09caa34460587230269b2e28a23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:36:45.904432 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-88cfe61c-870c-4eb7-90c6-17bd4b98db2d tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781" status: 200 len: 1654 microversion: 2.20 time: 0.298641 Apr 30 13:36:45.904979 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 853/1814] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:36:45 2021] GET /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781 => generated 1654 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 30 13:36:46.288851 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [req-21434b2b-cdbc-418b-99ca-9181dbd038ec req-90e228b8-5638-4cc2-8173-ac0617919161 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7973333b-d5a8-4786-8b0b-e441a0743781", "name": "network-vif-deleted", "tag": "b491a7a0-e823-4e08-9ba2-458449990f1b"}]} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:36:46.291520 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:36:46.291520 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: warnings.warn(msg) Apr 30 13:36:46.316672 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb5a7899-1fdb-42b6-bec0-d69e54b8f5a6] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 35372. Apr 30 13:36:46.322446 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-21434b2b-cdbc-418b-99ca-9181dbd038ec req-90e228b8-5638-4cc2-8173-ac0617919161 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:36:46.322968 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-21434b2b-cdbc-418b-99ca-9181dbd038ec req-90e228b8-5638-4cc2-8173-ac0617919161 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:36:46.341112 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.compute.server_external_events [req-21434b2b-cdbc-418b-99ca-9181dbd038ec req-90e228b8-5638-4cc2-8173-ac0617919161 service nova] Creating event network-vif-deleted:b491a7a0-e823-4e08-9ba2-458449990f1b for instance 7973333b-d5a8-4786-8b0b-e441a0743781 on hv-cinder-78836 Apr 30 13:36:46.346073 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [req-21434b2b-cdbc-418b-99ca-9181dbd038ec req-90e228b8-5638-4cc2-8173-ac0617919161 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061298 Apr 30 13:36:46.346741 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 962/1815] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:36:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:36:46.924808 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-558e5b9e-74a3-4c01-a8cd-fe080ee1e373 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:36:46.925647 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-558e5b9e-74a3-4c01-a8cd-fe080ee1e373 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:36:46.933556 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-558e5b9e-74a3-4c01-a8cd-fe080ee1e373 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:36:46.934308 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-558e5b9e-74a3-4c01-a8cd-fe080ee1e373 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:36:46.935327 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-558e5b9e-74a3-4c01-a8cd-fe080ee1e373 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:36:46.935900 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-558e5b9e-74a3-4c01-a8cd-fe080ee1e373 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:36:46.986918 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.wsgi [None req-558e5b9e-74a3-4c01-a8cd-fe080ee1e373 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] HTTP exception thrown: Instance 7973333b-d5a8-4786-8b0b-e441a0743781 could not be found. Apr 30 13:36:46.987435 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-558e5b9e-74a3-4c01-a8cd-fe080ee1e373 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Returning 404 to user: Instance 7973333b-d5a8-4786-8b0b-e441a0743781 could not be found. {{(pid=87932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:36:46.988278 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-558e5b9e-74a3-4c01-a8cd-fe080ee1e373 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781" status: 404 len: 111 microversion: 2.20 time: 0.069309 Apr 30 13:36:46.988837 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 854/1816] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Apr 30 13:36:46 2021] GET /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 30 13:36:46.998210 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-84736bc7-1e2e-4b90-8d57-4f6122e32994 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '.version_select at 0x7f7500146af0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:36:47.015558 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-84736bc7-1e2e-4b90-8d57-4f6122e32994 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-502429102" status: 204 len: 0 microversion: 2.20 time: 0.021665 Apr 30 13:36:47.016467 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 963/1817] 10.222.0.79 () {60 vars in 1259 bytes} [Fri Apr 30 13:36:46 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-502429102 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 30 13:38:22.735002 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:38:22.735646 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: Fri Apr 30 13:38:22 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:38:26.709461 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:38:26.710110 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: Fri Apr 30 13:38:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:38:47.451381 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:38:47.452067 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: Fri Apr 30 13:38:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:41:42.752535 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:41:42.753074 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: Fri Apr 30 13:41:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:41:46.727113 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:41:46.727665 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: Fri Apr 30 13:41:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:42:01.826601 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:42:01.827097 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: Fri Apr 30 13:42:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:42:02.516628 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:42:02.516793 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: Fri Apr 30 13:42:02 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:42:07.468390 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:42:07.468953 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: Fri Apr 30 13:42:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:42:16.976376 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:42:16.977068 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: Fri Apr 30 13:42:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:42:27.371668 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-62c373d5-d413-442d-889a-79f4b4c34754 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:42:27.372299 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-62c373d5-d413-442d-889a-79f4b4c34754 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:42:27.375538 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1abdcfbc-0fea-4857-8557-cdc275d2ef0c] AMQP server on 10.222.0.79:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 13:42:27.381281 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-62c373d5-d413-442d-889a-79f4b4c34754 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:42:27.381713 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-62c373d5-d413-442d-889a-79f4b4c34754 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:42:27.382532 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-62c373d5-d413-442d-889a-79f4b4c34754 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:42:27.382975 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-62c373d5-d413-442d-889a-79f4b4c34754 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:42:27.433519 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.wsgi [None req-62c373d5-d413-442d-889a-79f4b4c34754 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] HTTP exception thrown: Instance 3a50652a-d54a-4e55-a6cb-29c771123021 could not be found. Apr 30 13:42:27.434159 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-62c373d5-d413-442d-889a-79f4b4c34754 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Returning 404 to user: Instance 3a50652a-d54a-4e55-a6cb-29c771123021 could not be found. {{(pid=87932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:42:27.435005 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-62c373d5-d413-442d-889a-79f4b4c34754 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021" status: 404 len: 111 microversion: 2.1 time: 0.071271 Apr 30 13:42:27.435544 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 855/1818] 10.222.0.79 () {58 vars in 1239 bytes} [Fri Apr 30 13:42:27 2021] DELETE /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:42:27.448266 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-f675cf78-8111-4117-9cde-cbda5a1e5975 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:42:27.449479 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-f675cf78-8111-4117-9cde-cbda5a1e5975 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 3a50652a-d54a-4e55-a6cb-29c771123021] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:42:27.454807 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb5a7899-1fdb-42b6-bec0-d69e54b8f5a6] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 30 13:42:27.463624 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f675cf78-8111-4117-9cde-cbda5a1e5975 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:42:27.464384 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f675cf78-8111-4117-9cde-cbda5a1e5975 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:42:27.465694 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f675cf78-8111-4117-9cde-cbda5a1e5975 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:42:27.466509 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-f675cf78-8111-4117-9cde-cbda5a1e5975 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:42:27.551851 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.wsgi [None req-f675cf78-8111-4117-9cde-cbda5a1e5975 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] HTTP exception thrown: Instance 3a50652a-d54a-4e55-a6cb-29c771123021 could not be found. Apr 30 13:42:27.552563 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-f675cf78-8111-4117-9cde-cbda5a1e5975 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Returning 404 to user: Instance 3a50652a-d54a-4e55-a6cb-29c771123021 could not be found. {{(pid=87933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:42:27.553419 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-f675cf78-8111-4117-9cde-cbda5a1e5975 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "GET /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021" status: 404 len: 111 microversion: 2.1 time: 0.112161 Apr 30 13:42:27.553991 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 964/1819] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:42:27 2021] GET /compute/v2.1/servers/3a50652a-d54a-4e55-a6cb-29c771123021 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:42:48.810343 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-94d92ee8-e896-4b12-b0da-a8401b50ed86 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:42:48.811178 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-94d92ee8-e896-4b12-b0da-a8401b50ed86 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:42:48.836438 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-94d92ee8-e896-4b12-b0da-a8401b50ed86 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:42:48.837447 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-94d92ee8-e896-4b12-b0da-a8401b50ed86 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:42:48.839051 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-94d92ee8-e896-4b12-b0da-a8401b50ed86 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:42:48.839931 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-94d92ee8-e896-4b12-b0da-a8401b50ed86 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:42:48.881630 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO oslo.messaging._drivers.impl_rabbit [-] [1abdcfbc-0fea-4857-8557-cdc275d2ef0c] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 38158. Apr 30 13:42:48.899573 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.wsgi [None req-94d92ee8-e896-4b12-b0da-a8401b50ed86 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] HTTP exception thrown: Instance 7973333b-d5a8-4786-8b0b-e441a0743781 could not be found. Apr 30 13:42:48.900064 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-94d92ee8-e896-4b12-b0da-a8401b50ed86 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Returning 404 to user: Instance 7973333b-d5a8-4786-8b0b-e441a0743781 could not be found. {{(pid=87932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:42:48.900895 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-94d92ee8-e896-4b12-b0da-a8401b50ed86 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "DELETE /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781" status: 404 len: 111 microversion: 2.1 time: 0.094353 Apr 30 13:42:48.901429 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 856/1820] 10.222.0.79 () {58 vars in 1239 bytes} [Fri Apr 30 13:42:48 2021] DELETE /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:42:48.911298 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-153bc40e-2618-4680-a259-be74715d0daa tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:42:48.911916 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-153bc40e-2618-4680-a259-be74715d0daa tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: 7973333b-d5a8-4786-8b0b-e441a0743781] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:42:48.931032 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-153bc40e-2618-4680-a259-be74715d0daa tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:42:48.931608 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-153bc40e-2618-4680-a259-be74715d0daa tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:42:48.932550 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-153bc40e-2618-4680-a259-be74715d0daa tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:42:48.933180 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-153bc40e-2618-4680-a259-be74715d0daa tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:42:48.986508 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb5a7899-1fdb-42b6-bec0-d69e54b8f5a6] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 38162. Apr 30 13:42:48.987669 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.wsgi [None req-153bc40e-2618-4680-a259-be74715d0daa tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] HTTP exception thrown: Instance 7973333b-d5a8-4786-8b0b-e441a0743781 could not be found. Apr 30 13:42:48.988268 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-153bc40e-2618-4680-a259-be74715d0daa tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Returning 404 to user: Instance 7973333b-d5a8-4786-8b0b-e441a0743781 could not be found. {{(pid=87933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:42:48.989113 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-153bc40e-2618-4680-a259-be74715d0daa tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781" status: 404 len: 111 microversion: 2.1 time: 0.082533 Apr 30 13:42:48.989662 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 965/1821] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:42:48 2021] GET /compute/v2.1/servers/7973333b-d5a8-4786-8b0b-e441a0743781 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:45:02.772135 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:45:02.772756 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: Fri Apr 30 13:45:02 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:45:06.746030 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:45:06.746616 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: Fri Apr 30 13:45:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:45:21.846706 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:45:21.847294 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: Fri Apr 30 13:45:21 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:45:22.535344 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:45:22.535592 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: Fri Apr 30 13:45:22 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:45:27.486197 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:45:27.487054 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: Fri Apr 30 13:45:27 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:45:36.996244 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:45:36.996827 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: Fri Apr 30 13:45:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:48:22.790138 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:48:22.790805 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: Fri Apr 30 13:48:22 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:48:26.763515 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:48:26.764748 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: Fri Apr 30 13:48:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:48:27.940784 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1abdcfbc-0fea-4857-8557-cdc275d2ef0c] AMQP server on 10.222.0.79:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 13:48:27.944076 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-e7cc2818-45e9-4cc9-9122-5657c13f6034 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:48:27.944577 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-e7cc2818-45e9-4cc9-9122-5657c13f6034 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 51ec80af-a515-409f-a251-9d0a9718889b] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:48:27.952448 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e7cc2818-45e9-4cc9-9122-5657c13f6034 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:48:27.952904 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e7cc2818-45e9-4cc9-9122-5657c13f6034 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:48:27.953680 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e7cc2818-45e9-4cc9-9122-5657c13f6034 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:48:27.954155 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e7cc2818-45e9-4cc9-9122-5657c13f6034 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:48:28.003233 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.wsgi [None req-e7cc2818-45e9-4cc9-9122-5657c13f6034 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] HTTP exception thrown: Instance 51ec80af-a515-409f-a251-9d0a9718889b could not be found. Apr 30 13:48:28.003836 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-e7cc2818-45e9-4cc9-9122-5657c13f6034 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Returning 404 to user: Instance 51ec80af-a515-409f-a251-9d0a9718889b could not be found. {{(pid=87932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:48:28.004668 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-e7cc2818-45e9-4cc9-9122-5657c13f6034 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "DELETE /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b" status: 404 len: 111 microversion: 2.1 time: 0.065448 Apr 30 13:48:28.005213 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 857/1822] 10.222.0.79 () {58 vars in 1239 bytes} [Fri Apr 30 13:48:27 2021] DELETE /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:48:28.011061 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb5a7899-1fdb-42b6-bec0-d69e54b8f5a6] AMQP server on 10.222.0.79:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 13:48:28.015300 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-e37f79a3-2aef-4319-9fb2-3f00bf6e4404 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:48:28.015863 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-e37f79a3-2aef-4319-9fb2-3f00bf6e4404 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] [instance: 51ec80af-a515-409f-a251-9d0a9718889b] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:48:28.023151 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e37f79a3-2aef-4319-9fb2-3f00bf6e4404 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:48:28.023609 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e37f79a3-2aef-4319-9fb2-3f00bf6e4404 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:48:28.024399 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e37f79a3-2aef-4319-9fb2-3f00bf6e4404 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:48:28.024843 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e37f79a3-2aef-4319-9fb2-3f00bf6e4404 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:48:28.074297 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.wsgi [None req-e37f79a3-2aef-4319-9fb2-3f00bf6e4404 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] HTTP exception thrown: Instance 51ec80af-a515-409f-a251-9d0a9718889b could not be found. Apr 30 13:48:28.074899 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-e37f79a3-2aef-4319-9fb2-3f00bf6e4404 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] Returning 404 to user: Instance 51ec80af-a515-409f-a251-9d0a9718889b could not be found. {{(pid=87933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:48:28.075737 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-e37f79a3-2aef-4319-9fb2-3f00bf6e4404 tempest-AttachVolumeTestJSON-1567094918 tempest-AttachVolumeTestJSON-1567094918-project] 10.222.0.79 "GET /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b" status: 404 len: 111 microversion: 2.1 time: 0.066460 Apr 30 13:48:28.076458 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 966/1823] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:48:28 2021] GET /compute/v2.1/servers/51ec80af-a515-409f-a251-9d0a9718889b => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 13:48:35.071245 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO oslo.messaging._drivers.impl_rabbit [-] [1abdcfbc-0fea-4857-8557-cdc275d2ef0c] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 40898. Apr 30 13:48:35.227445 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-9abf895c-80a3-4564-a193-3c0d874b9eee tempest-VolumesNegativeTest-272266659 tempest-VolumesNegativeTest-272266659-project] Action: 'create', calling method: .version_select at 0x7f74fbf6d820>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-400316289", "metadata": {"Type": "work"}}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:48:35.228913 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-9abf895c-80a3-4564-a193-3c0d874b9eee tempest-VolumesNegativeTest-272266659 tempest-VolumesNegativeTest-272266659-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=87932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:48:35.229707 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-9abf895c-80a3-4564-a193-3c0d874b9eee tempest-VolumesNegativeTest-272266659 tempest-VolumesNegativeTest-272266659-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.179422 Apr 30 13:48:35.230264 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 858/1824] 10.222.0.79 () {60 vars in 1156 bytes} [Fri Apr 30 13:48:35 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 181 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 13:48:35.239373 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-d1314943-9f88-40b5-8fc8-2c4413bf2c8b tempest-VolumesNegativeTest-272266659 tempest-VolumesNegativeTest-272266659-project] Action: 'create', calling method: .version_select at 0x7f750155ed30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1700036113", "metadata": {"Type": "work"}}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:48:35.240840 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-d1314943-9f88-40b5-8fc8-2c4413bf2c8b tempest-VolumesNegativeTest-272266659 tempest-VolumesNegativeTest-272266659-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=87933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:48:35.242110 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-d1314943-9f88-40b5-8fc8-2c4413bf2c8b tempest-VolumesNegativeTest-272266659 tempest-VolumesNegativeTest-272266659-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.005993 Apr 30 13:48:35.242274 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 967/1825] 10.222.0.79 () {60 vars in 1156 bytes} [Fri Apr 30 13:48:35 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 30 13:48:35.250876 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-2b0eec39-9415-4e44-a7b3-0026f340814f tempest-VolumesNegativeTest-272266659 tempest-VolumesNegativeTest-272266659-project] Action: 'create', calling method: .version_select at 0x7f750011fe50>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-471162882", "metadata": {"Type": "work"}}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:48:35.252719 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-2b0eec39-9415-4e44-a7b3-0026f340814f tempest-VolumesNegativeTest-272266659 tempest-VolumesNegativeTest-272266659-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=87932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:48:35.253526 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-2b0eec39-9415-4e44-a7b3-0026f340814f tempest-VolumesNegativeTest-272266659 tempest-VolumesNegativeTest-272266659-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006212 Apr 30 13:48:35.254110 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 859/1826] 10.222.0.79 () {60 vars in 1156 bytes} [Fri Apr 30 13:48:35 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 30 13:48:35.274262 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-d0c27e8e-5f54-403e-8303-3e88faa6d08c tempest-VolumesNegativeTest-272266659 tempest-VolumesNegativeTest-272266659-project] Calling method '.version_select at 0x7f74fb7d6550>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:48:35.288699 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb5a7899-1fdb-42b6-bec0-d69e54b8f5a6] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 40908. Apr 30 13:48:35.456082 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.wsgi [None req-d0c27e8e-5f54-403e-8303-3e88faa6d08c tempest-VolumesNegativeTest-272266659 tempest-VolumesNegativeTest-272266659-project] HTTP exception thrown: Volume tempest-invalid-211828199 could not be found. Apr 30 13:48:35.456691 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-d0c27e8e-5f54-403e-8303-3e88faa6d08c tempest-VolumesNegativeTest-272266659 tempest-VolumesNegativeTest-272266659-project] Returning 404 to user: Volume tempest-invalid-211828199 could not be found. {{(pid=87933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:48:35.457826 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-d0c27e8e-5f54-403e-8303-3e88faa6d08c tempest-VolumesNegativeTest-272266659 tempest-VolumesNegativeTest-272266659-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/tempest-invalid-211828199" status: 404 len: 98 microversion: 2.1 time: 0.198811 Apr 30 13:48:35.458400 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 968/1827] 10.222.0.79 () {58 vars in 1215 bytes} [Fri Apr 30 13:48:35 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-211828199 => generated 98 bytes in 200 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 30 13:48:35.473202 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-843fe2d0-072e-43e1-b661-acb17f0c75bd tempest-VolumesNegativeTest-272266659 tempest-VolumesNegativeTest-272266659-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008394 Apr 30 13:48:35.473724 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 860/1828] 10.222.0.79 () {58 vars in 1140 bytes} [Fri Apr 30 13:48:35 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 30 13:48:35.483963 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-c877e053-2509-42e0-a626-21ca8b505f1e tempest-VolumesNegativeTest-272266659 tempest-VolumesNegativeTest-272266659-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003851 Apr 30 13:48:35.484666 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 969/1829] 10.222.0.79 () {58 vars in 1137 bytes} [Fri Apr 30 13:48:35 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 30 13:48:35.500359 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-a0ed88f0-02ec-43d4-b634-13550c4041c9 tempest-VolumesNegativeTest-272266659 tempest-VolumesNegativeTest-272266659-project] Calling method '.version_select at 0x7f74fbf6d430>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:48:35.616292 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.wsgi [None req-a0ed88f0-02ec-43d4-b634-13550c4041c9 tempest-VolumesNegativeTest-272266659 tempest-VolumesNegativeTest-272266659-project] HTTP exception thrown: Volume b7b2f02f-59f3-4b71-9f73-386c2e54f5e0 could not be found. Apr 30 13:48:35.616904 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-a0ed88f0-02ec-43d4-b634-13550c4041c9 tempest-VolumesNegativeTest-272266659 tempest-VolumesNegativeTest-272266659-project] Returning 404 to user: Volume b7b2f02f-59f3-4b71-9f73-386c2e54f5e0 could not be found. {{(pid=87932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:48:35.617762 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-a0ed88f0-02ec-43d4-b634-13550c4041c9 tempest-VolumesNegativeTest-272266659 tempest-VolumesNegativeTest-272266659-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/b7b2f02f-59f3-4b71-9f73-386c2e54f5e0" status: 404 len: 109 microversion: 2.1 time: 0.125321 Apr 30 13:48:35.618353 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 861/1830] 10.222.0.79 () {58 vars in 1248 bytes} [Fri Apr 30 13:48:35 2021] DELETE /compute/v2.1/os-volumes/b7b2f02f-59f3-4b71-9f73-386c2e54f5e0 => generated 109 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:48:35.631682 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-05d7729c-186b-48b2-9254-8c6f254c3e76 tempest-VolumesNegativeTest-272266659 tempest-VolumesNegativeTest-272266659-project] Calling method '.version_select at 0x7f7500c6fa60>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:48:35.692869 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.wsgi [None req-05d7729c-186b-48b2-9254-8c6f254c3e76 tempest-VolumesNegativeTest-272266659 tempest-VolumesNegativeTest-272266659-project] HTTP exception thrown: Volume 1aeba86a-aae3-4da2-9cf1-3f816e86bc5d could not be found. Apr 30 13:48:35.693499 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-05d7729c-186b-48b2-9254-8c6f254c3e76 tempest-VolumesNegativeTest-272266659 tempest-VolumesNegativeTest-272266659-project] Returning 404 to user: Volume 1aeba86a-aae3-4da2-9cf1-3f816e86bc5d could not be found. {{(pid=87933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:48:35.694400 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-05d7729c-186b-48b2-9254-8c6f254c3e76 tempest-VolumesNegativeTest-272266659 tempest-VolumesNegativeTest-272266659-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/1aeba86a-aae3-4da2-9cf1-3f816e86bc5d" status: 404 len: 109 microversion: 2.1 time: 0.069633 Apr 30 13:48:35.694983 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 970/1831] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Apr 30 13:48:35 2021] GET /compute/v2.1/os-volumes/1aeba86a-aae3-4da2-9cf1-3f816e86bc5d => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:48:41.864828 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:48:41.865453 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: Fri Apr 30 13:48:41 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:48:42.554341 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:48:42.554556 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: Fri Apr 30 13:48:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:48:47.505123 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:48:47.505123 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: Fri Apr 30 13:48:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:48:49.618586 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-35f8cf3b-6a95-4c38-9c73-55fd1750c2ce tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:48:49.619987 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-35f8cf3b-6a95-4c38-9c73-55fd1750c2ce tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:48:49.628774 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-35f8cf3b-6a95-4c38-9c73-55fd1750c2ce tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:48:49.629216 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-35f8cf3b-6a95-4c38-9c73-55fd1750c2ce tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:48:49.630063 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-35f8cf3b-6a95-4c38-9c73-55fd1750c2ce tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:48:49.630501 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-35f8cf3b-6a95-4c38-9c73-55fd1750c2ce tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:48:49.684065 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.wsgi [None req-35f8cf3b-6a95-4c38-9c73-55fd1750c2ce tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] HTTP exception thrown: Instance ad3419a7-71af-4a52-bcb7-6048e0553df9 could not be found. Apr 30 13:48:49.685432 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-35f8cf3b-6a95-4c38-9c73-55fd1750c2ce tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Returning 404 to user: Instance ad3419a7-71af-4a52-bcb7-6048e0553df9 could not be found. {{(pid=87932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:48:49.686462 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-35f8cf3b-6a95-4c38-9c73-55fd1750c2ce tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "DELETE /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 404 len: 111 microversion: 2.1 time: 0.075741 Apr 30 13:48:49.687035 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 862/1832] 10.222.0.79 () {58 vars in 1239 bytes} [Fri Apr 30 13:48:49 2021] DELETE /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:48:49.695139 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-3cba341a-9b99-45bc-8f09-a3b075c3e469 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:48:49.695768 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-3cba341a-9b99-45bc-8f09-a3b075c3e469 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] [instance: ad3419a7-71af-4a52-bcb7-6048e0553df9] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:48:49.704947 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3cba341a-9b99-45bc-8f09-a3b075c3e469 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:48:49.705396 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3cba341a-9b99-45bc-8f09-a3b075c3e469 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:48:49.706657 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3cba341a-9b99-45bc-8f09-a3b075c3e469 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:48:49.706657 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3cba341a-9b99-45bc-8f09-a3b075c3e469 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:48:49.764130 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.wsgi [None req-3cba341a-9b99-45bc-8f09-a3b075c3e469 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] HTTP exception thrown: Instance ad3419a7-71af-4a52-bcb7-6048e0553df9 could not be found. Apr 30 13:48:49.764852 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-3cba341a-9b99-45bc-8f09-a3b075c3e469 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] Returning 404 to user: Instance ad3419a7-71af-4a52-bcb7-6048e0553df9 could not be found. {{(pid=87933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:48:49.765942 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-3cba341a-9b99-45bc-8f09-a3b075c3e469 tempest-AttachVolumeShelveTestJSON-1116128006 tempest-AttachVolumeShelveTestJSON-1116128006-project] 10.222.0.79 "GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9" status: 404 len: 111 microversion: 2.1 time: 0.074504 Apr 30 13:48:49.767663 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 971/1833] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:48:49 2021] GET /compute/v2.1/servers/ad3419a7-71af-4a52-bcb7-6048e0553df9 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:48:57.014838 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:48:57.015650 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: Fri Apr 30 13:48:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:51:42.808504 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:51:42.809146 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: Fri Apr 30 13:51:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:51:46.784292 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:51:46.784817 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: Fri Apr 30 13:51:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:52:01.894469 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:52:01.895144 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: Fri Apr 30 13:52:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:52:02.574250 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:52:02.574549 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: Fri Apr 30 13:52:02 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:52:07.530707 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:52:07.531265 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: Fri Apr 30 13:52:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:52:17.035436 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:52:17.036089 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: Fri Apr 30 13:52:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:53:50.694464 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-c1954a49-c090-4a2c-b4dc-d73f39536f03 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Action: 'create', calling method: .version_select at 0x7f75001619d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2070195306"}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:53:50.701158 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1abdcfbc-0fea-4857-8557-cdc275d2ef0c] AMQP server on 10.222.0.79:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 13:53:50.719156 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.quota [None req-c1954a49-c090-4a2c-b4dc-d73f39536f03 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Getting quotas for project 7dbbf6d943814b7e84f6af3fb089971f. Resources: {'key_pairs'} {{(pid=87932) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:53:50.723985 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.quota [None req-c1954a49-c090-4a2c-b4dc-d73f39536f03 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Getting quotas for user f5c8ea3509484601812bb4e1dd150439 and project 7dbbf6d943814b7e84f6af3fb089971f. Resources: {'key_pairs'} {{(pid=87932) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:53:51.120412 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.quota [None req-c1954a49-c090-4a2c-b4dc-d73f39536f03 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Getting quotas for project 7dbbf6d943814b7e84f6af3fb089971f. Resources: {'key_pairs'} {{(pid=87932) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:53:51.124352 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.quota [None req-c1954a49-c090-4a2c-b4dc-d73f39536f03 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Getting quotas for user f5c8ea3509484601812bb4e1dd150439 and project 7dbbf6d943814b7e84f6af3fb089971f. Resources: {'key_pairs'} {{(pid=87932) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:53:51.139441 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-c1954a49-c090-4a2c-b4dc-d73f39536f03 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.449803 Apr 30 13:53:51.140036 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 863/1834] 10.222.0.79 () {60 vars in 1158 bytes} [Fri Apr 30 13:53:50 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:53:51.190933 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb5a7899-1fdb-42b6-bec0-d69e54b8f5a6] AMQP server on 10.222.0.79:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 13:53:51.196118 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-eafbc45c-f008-4c52-b878-c2662fc4d440 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-456617868", "imageRef": "c0f39f45-9349-4d55-8ba4-3c89c0240560", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2070195306", "networks": [{"uuid": "d520f47b-026f-4719-93d8-3db04d2b1c1d"}]}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:53:51.400297 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.network.neutron [None req-eafbc45c-f008-4c52-b878-c2662fc4d440 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] validate_networks() for [('d520f47b-026f-4719-93d8-3db04d2b1c1d', None, None, None)] {{(pid=87933) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 13:53:52.114978 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.virt.hardware [None req-eafbc45c-f008-4c52-b878-c2662fc4d440 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Flavor limits 0:0:0 {{(pid=87933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 13:53:52.115736 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.virt.hardware [None req-eafbc45c-f008-4c52-b878-c2662fc4d440 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Image limits 0:0:0 {{(pid=87933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 13:53:52.116625 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.virt.hardware [None req-eafbc45c-f008-4c52-b878-c2662fc4d440 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Flavor pref 0:0:0 {{(pid=87933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 13:53:52.117390 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.virt.hardware [None req-eafbc45c-f008-4c52-b878-c2662fc4d440 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Image pref 0:0:0 {{(pid=87933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 13:53:52.118164 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.virt.hardware [None req-eafbc45c-f008-4c52-b878-c2662fc4d440 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 13:53:52.129000 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-eafbc45c-f008-4c52-b878-c2662fc4d440 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:53:52.130359 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-eafbc45c-f008-4c52-b878-c2662fc4d440 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:53:52.131518 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-eafbc45c-f008-4c52-b878-c2662fc4d440 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:53:52.132044 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-eafbc45c-f008-4c52-b878-c2662fc4d440 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:53:52.157343 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.quota [None req-eafbc45c-f008-4c52-b878-c2662fc4d440 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Getting quotas for project 7dbbf6d943814b7e84f6af3fb089971f. Resources: {'ram', 'instances', 'cores'} {{(pid=87933) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:53:52.165742 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.quota [None req-eafbc45c-f008-4c52-b878-c2662fc4d440 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Getting quotas for user f5c8ea3509484601812bb4e1dd150439 and project 7dbbf6d943814b7e84f6af3fb089971f. Resources: {'ram', 'instances', 'cores'} {{(pid=87933) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:53:52.179438 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-eafbc45c-f008-4c52-b878-c2662fc4d440 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Going to run 1 instances... {{(pid=87933) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 13:53:52.181730 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-eafbc45c-f008-4c52-b878-c2662fc4d440 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] [instance: b732fd76-455b-4064-a885-31459b462751] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c0f39f45-9349-4d55-8ba4-3c89c0240560',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=87933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 13:53:52.226377 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb5a7899-1fdb-42b6-bec0-d69e54b8f5a6] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 44038. Apr 30 13:53:52.242959 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-eafbc45c-f008-4c52-b878-c2662fc4d440 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.053413 Apr 30 13:53:52.243615 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 972/1835] 10.222.0.79 () {60 vars in 1147 bytes} [Fri Apr 30 13:53:51 2021] POST /compute/v2.1/servers => generated 380 bytes in 1055 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 13:53:52.266771 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-c8ed84ab-d08c-4a16-bbd2-d2f6c7866a10 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:53:52.267759 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-c8ed84ab-d08c-4a16-bbd2-d2f6c7866a10 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] [instance: b732fd76-455b-4064-a885-31459b462751] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:53:52.294154 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO oslo.messaging._drivers.impl_rabbit [-] [1abdcfbc-0fea-4857-8557-cdc275d2ef0c] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 44042. Apr 30 13:53:52.406305 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-c8ed84ab-d08c-4a16-bbd2-d2f6c7866a10 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c8ea3509484601812bb4e1dd150439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbbf6d943814b7e84f6af3fb089971f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:53:52.420230 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-c8ed84ab-d08c-4a16-bbd2-d2f6c7866a10 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] 10.222.0.79 "GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751" status: 200 len: 1258 microversion: 2.1 time: 0.170544 Apr 30 13:53:52.421467 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 864/1836] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:53:52 2021] GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751 => generated 1258 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:53:53.447186 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-075dd83d-6301-4ac1-a634-2498e6faec9b tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:53:53.448354 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-075dd83d-6301-4ac1-a634-2498e6faec9b tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] [instance: b732fd76-455b-4064-a885-31459b462751] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:53:53.460614 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-075dd83d-6301-4ac1-a634-2498e6faec9b tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:53:53.461160 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-075dd83d-6301-4ac1-a634-2498e6faec9b tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:53:53.461985 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-075dd83d-6301-4ac1-a634-2498e6faec9b tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:53:53.462458 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-075dd83d-6301-4ac1-a634-2498e6faec9b tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:53:53.579008 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-075dd83d-6301-4ac1-a634-2498e6faec9b tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c8ea3509484601812bb4e1dd150439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbbf6d943814b7e84f6af3fb089971f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:53:53.588113 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-075dd83d-6301-4ac1-a634-2498e6faec9b tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] 10.222.0.79 "GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751" status: 200 len: 1310 microversion: 2.1 time: 0.146808 Apr 30 13:53:53.588609 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 973/1837] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:53:53 2021] GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751 => generated 1310 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:53:54.609655 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-93f27e8b-2f7d-4e1c-beb9-979a8610ba48 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:53:54.610658 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-93f27e8b-2f7d-4e1c-beb9-979a8610ba48 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] [instance: b732fd76-455b-4064-a885-31459b462751] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:53:54.640283 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-93f27e8b-2f7d-4e1c-beb9-979a8610ba48 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:53:54.649637 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-93f27e8b-2f7d-4e1c-beb9-979a8610ba48 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:53:54.651365 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-93f27e8b-2f7d-4e1c-beb9-979a8610ba48 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:53:54.652010 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-93f27e8b-2f7d-4e1c-beb9-979a8610ba48 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:53:54.938661 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-93f27e8b-2f7d-4e1c-beb9-979a8610ba48 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c8ea3509484601812bb4e1dd150439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbbf6d943814b7e84f6af3fb089971f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:53:54.958917 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-93f27e8b-2f7d-4e1c-beb9-979a8610ba48 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] 10.222.0.79 "GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751" status: 200 len: 1316 microversion: 2.1 time: 0.355622 Apr 30 13:53:54.959885 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 865/1838] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:53:54 2021] GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751 => generated 1316 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:53:55.981822 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-dc8c8aaa-a69c-41b1-989e-52014274cfdf tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:53:55.982903 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-dc8c8aaa-a69c-41b1-989e-52014274cfdf tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] [instance: b732fd76-455b-4064-a885-31459b462751] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:53:55.991975 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-dc8c8aaa-a69c-41b1-989e-52014274cfdf tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:53:55.992435 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-dc8c8aaa-a69c-41b1-989e-52014274cfdf tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:53:55.993230 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-dc8c8aaa-a69c-41b1-989e-52014274cfdf tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:53:55.993668 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-dc8c8aaa-a69c-41b1-989e-52014274cfdf tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:53:56.235279 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-dc8c8aaa-a69c-41b1-989e-52014274cfdf tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c8ea3509484601812bb4e1dd150439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbbf6d943814b7e84f6af3fb089971f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:53:56.246048 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-dc8c8aaa-a69c-41b1-989e-52014274cfdf tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] 10.222.0.79 "GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751" status: 200 len: 1358 microversion: 2.1 time: 0.268283 Apr 30 13:53:56.246629 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 974/1839] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:53:55 2021] GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751 => generated 1358 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:53:57.263848 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-20d57136-7a16-447d-8726-a92efee08a10 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:53:57.264653 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-20d57136-7a16-447d-8726-a92efee08a10 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] [instance: b732fd76-455b-4064-a885-31459b462751] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:53:57.274699 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-20d57136-7a16-447d-8726-a92efee08a10 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:53:57.275327 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-20d57136-7a16-447d-8726-a92efee08a10 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:53:57.276361 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-20d57136-7a16-447d-8726-a92efee08a10 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:53:57.276940 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-20d57136-7a16-447d-8726-a92efee08a10 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:53:57.615517 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-20d57136-7a16-447d-8726-a92efee08a10 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c8ea3509484601812bb4e1dd150439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbbf6d943814b7e84f6af3fb089971f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:53:57.626700 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-20d57136-7a16-447d-8726-a92efee08a10 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] 10.222.0.79 "GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751" status: 200 len: 1358 microversion: 2.1 time: 0.366614 Apr 30 13:53:57.627200 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 866/1840] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:53:57 2021] GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751 => generated 1358 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:53:58.643659 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-43c88aa7-b5da-49d3-b416-c0508473ef73 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:53:58.644297 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-43c88aa7-b5da-49d3-b416-c0508473ef73 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] [instance: b732fd76-455b-4064-a885-31459b462751] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:53:58.653225 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-43c88aa7-b5da-49d3-b416-c0508473ef73 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:53:58.653850 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-43c88aa7-b5da-49d3-b416-c0508473ef73 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:53:58.655074 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-43c88aa7-b5da-49d3-b416-c0508473ef73 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:53:58.655638 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-43c88aa7-b5da-49d3-b416-c0508473ef73 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:53:59.010905 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-43c88aa7-b5da-49d3-b416-c0508473ef73 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c8ea3509484601812bb4e1dd150439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbbf6d943814b7e84f6af3fb089971f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:53:59.023716 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-43c88aa7-b5da-49d3-b416-c0508473ef73 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] 10.222.0.79 "GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751" status: 200 len: 1358 microversion: 2.1 time: 0.383611 Apr 30 13:53:59.024384 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 975/1841] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:53:58 2021] GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751 => generated 1358 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:54:00.040966 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-b88931d2-9745-411d-822b-91670e3ef132 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:54:00.041585 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-b88931d2-9745-411d-822b-91670e3ef132 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] [instance: b732fd76-455b-4064-a885-31459b462751] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:54:00.052805 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b88931d2-9745-411d-822b-91670e3ef132 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:00.053258 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b88931d2-9745-411d-822b-91670e3ef132 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:00.054089 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b88931d2-9745-411d-822b-91670e3ef132 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:00.054641 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b88931d2-9745-411d-822b-91670e3ef132 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:00.326496 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-b88931d2-9745-411d-822b-91670e3ef132 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c8ea3509484601812bb4e1dd150439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbbf6d943814b7e84f6af3fb089971f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:54:00.336610 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-b88931d2-9745-411d-822b-91670e3ef132 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] 10.222.0.79 "GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751" status: 200 len: 1358 microversion: 2.1 time: 0.299315 Apr 30 13:54:00.337637 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 867/1842] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:54:00 2021] GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751 => generated 1358 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:54:01.359601 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-fd8ab1cf-59ba-4bdb-9c3a-2f5a881ff443 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:54:01.360256 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-fd8ab1cf-59ba-4bdb-9c3a-2f5a881ff443 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] [instance: b732fd76-455b-4064-a885-31459b462751] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:54:01.369113 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-fd8ab1cf-59ba-4bdb-9c3a-2f5a881ff443 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:01.369574 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-fd8ab1cf-59ba-4bdb-9c3a-2f5a881ff443 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:01.370410 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-fd8ab1cf-59ba-4bdb-9c3a-2f5a881ff443 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:01.370855 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-fd8ab1cf-59ba-4bdb-9c3a-2f5a881ff443 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:01.759808 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-fd8ab1cf-59ba-4bdb-9c3a-2f5a881ff443 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c8ea3509484601812bb4e1dd150439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbbf6d943814b7e84f6af3fb089971f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:54:01.771669 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-fd8ab1cf-59ba-4bdb-9c3a-2f5a881ff443 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] 10.222.0.79 "GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751" status: 200 len: 1358 microversion: 2.1 time: 0.415522 Apr 30 13:54:01.784715 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 976/1843] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:54:01 2021] GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751 => generated 1358 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:54:02.802674 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-cb47b233-97ab-4ecb-92f4-9917087d3922 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:54:02.806489 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-cb47b233-97ab-4ecb-92f4-9917087d3922 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] [instance: b732fd76-455b-4064-a885-31459b462751] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:54:02.841856 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cb47b233-97ab-4ecb-92f4-9917087d3922 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:02.847373 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cb47b233-97ab-4ecb-92f4-9917087d3922 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:02.853333 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cb47b233-97ab-4ecb-92f4-9917087d3922 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:02.854336 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cb47b233-97ab-4ecb-92f4-9917087d3922 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:03.196271 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-cb47b233-97ab-4ecb-92f4-9917087d3922 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c8ea3509484601812bb4e1dd150439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbbf6d943814b7e84f6af3fb089971f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:54:03.205612 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-cb47b233-97ab-4ecb-92f4-9917087d3922 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] 10.222.0.79 "GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751" status: 200 len: 1358 microversion: 2.1 time: 0.413234 Apr 30 13:54:03.206213 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 868/1844] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:54:02 2021] GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751 => generated 1358 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:54:04.237311 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-ba5f7b61-2cf3-4506-895d-a36b06fb09ec tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:54:04.238661 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-ba5f7b61-2cf3-4506-895d-a36b06fb09ec tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] [instance: b732fd76-455b-4064-a885-31459b462751] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:54:04.251795 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ba5f7b61-2cf3-4506-895d-a36b06fb09ec tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:04.252255 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ba5f7b61-2cf3-4506-895d-a36b06fb09ec tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:04.253061 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ba5f7b61-2cf3-4506-895d-a36b06fb09ec tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:04.253506 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ba5f7b61-2cf3-4506-895d-a36b06fb09ec tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:04.547613 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-ba5f7b61-2cf3-4506-895d-a36b06fb09ec tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c8ea3509484601812bb4e1dd150439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbbf6d943814b7e84f6af3fb089971f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:54:04.573357 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-ba5f7b61-2cf3-4506-895d-a36b06fb09ec tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] 10.222.0.79 "GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751" status: 200 len: 1358 microversion: 2.1 time: 0.342037 Apr 30 13:54:04.573944 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 977/1845] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:54:04 2021] GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751 => generated 1358 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:54:05.594888 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-6b92ebf6-1548-489b-b150-81941cce4643 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:54:05.595530 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-6b92ebf6-1548-489b-b150-81941cce4643 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] [instance: b732fd76-455b-4064-a885-31459b462751] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:54:05.603544 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6b92ebf6-1548-489b-b150-81941cce4643 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:05.603987 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6b92ebf6-1548-489b-b150-81941cce4643 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:05.604773 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6b92ebf6-1548-489b-b150-81941cce4643 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:05.605203 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6b92ebf6-1548-489b-b150-81941cce4643 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:05.821062 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-6b92ebf6-1548-489b-b150-81941cce4643 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c8ea3509484601812bb4e1dd150439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbbf6d943814b7e84f6af3fb089971f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:54:05.835496 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-6b92ebf6-1548-489b-b150-81941cce4643 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] 10.222.0.79 "GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751" status: 200 len: 1358 microversion: 2.1 time: 0.244331 Apr 30 13:54:05.836100 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 869/1846] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:54:05 2021] GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751 => generated 1358 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:54:06.856587 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-36cb72ba-463d-4e50-8ada-e7efd57a98d0 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:54:06.857382 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-36cb72ba-463d-4e50-8ada-e7efd57a98d0 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] [instance: b732fd76-455b-4064-a885-31459b462751] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:54:06.866166 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-36cb72ba-463d-4e50-8ada-e7efd57a98d0 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:06.866610 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-36cb72ba-463d-4e50-8ada-e7efd57a98d0 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:06.867408 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-36cb72ba-463d-4e50-8ada-e7efd57a98d0 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:06.868146 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-36cb72ba-463d-4e50-8ada-e7efd57a98d0 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:07.158223 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-36cb72ba-463d-4e50-8ada-e7efd57a98d0 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c8ea3509484601812bb4e1dd150439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbbf6d943814b7e84f6af3fb089971f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:54:07.174249 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-36cb72ba-463d-4e50-8ada-e7efd57a98d0 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] 10.222.0.79 "GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751" status: 200 len: 1358 microversion: 2.1 time: 0.322590 Apr 30 13:54:07.175133 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 978/1847] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:54:06 2021] GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751 => generated 1358 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:54:07.310861 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [req-37d6df98-e198-4167-b790-5315c79484d4 req-24a7dabd-27de-4c9d-9bca-404937e92745 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b732fd76-455b-4064-a885-31459b462751", "tag": "6817d8b9-ec7d-40e5-a19f-7757ae2ef7b7"}]} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:54:07.312479 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:54:07.312479 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: warnings.warn(msg) Apr 30 13:54:07.327213 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-37d6df98-e198-4167-b790-5315c79484d4 req-24a7dabd-27de-4c9d-9bca-404937e92745 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:07.328127 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-37d6df98-e198-4167-b790-5315c79484d4 req-24a7dabd-27de-4c9d-9bca-404937e92745 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:07.348615 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.compute.server_external_events [req-37d6df98-e198-4167-b790-5315c79484d4 req-24a7dabd-27de-4c9d-9bca-404937e92745 service nova] Creating event network-changed:6817d8b9-ec7d-40e5-a19f-7757ae2ef7b7 for instance b732fd76-455b-4064-a885-31459b462751 on hv-cinder-78836 Apr 30 13:54:07.355709 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [req-37d6df98-e198-4167-b790-5315c79484d4 req-24a7dabd-27de-4c9d-9bca-404937e92745 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142931 Apr 30 13:54:07.357198 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 870/1848] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:54:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:54:08.200656 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-6014cdc3-ca6b-437f-bfc4-bfd27158dfc7 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:54:08.201949 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-6014cdc3-ca6b-437f-bfc4-bfd27158dfc7 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] [instance: b732fd76-455b-4064-a885-31459b462751] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:54:08.211220 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6014cdc3-ca6b-437f-bfc4-bfd27158dfc7 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:08.211685 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6014cdc3-ca6b-437f-bfc4-bfd27158dfc7 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:08.212527 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6014cdc3-ca6b-437f-bfc4-bfd27158dfc7 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:08.212979 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6014cdc3-ca6b-437f-bfc4-bfd27158dfc7 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:08.512819 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-6014cdc3-ca6b-437f-bfc4-bfd27158dfc7 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c8ea3509484601812bb4e1dd150439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbbf6d943814b7e84f6af3fb089971f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:54:08.526343 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-6014cdc3-ca6b-437f-bfc4-bfd27158dfc7 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] 10.222.0.79 "GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751" status: 200 len: 1358 microversion: 2.1 time: 0.329959 Apr 30 13:54:08.527340 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 979/1849] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:54:08 2021] GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751 => generated 1358 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:54:09.548653 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-9c06f07e-4e16-4045-ac99-305275364128 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:54:09.549272 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-9c06f07e-4e16-4045-ac99-305275364128 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] [instance: b732fd76-455b-4064-a885-31459b462751] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:54:09.557925 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9c06f07e-4e16-4045-ac99-305275364128 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:09.558412 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9c06f07e-4e16-4045-ac99-305275364128 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:09.559200 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9c06f07e-4e16-4045-ac99-305275364128 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:09.559701 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-9c06f07e-4e16-4045-ac99-305275364128 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:09.793036 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-9c06f07e-4e16-4045-ac99-305275364128 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c8ea3509484601812bb4e1dd150439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbbf6d943814b7e84f6af3fb089971f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:54:09.806647 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-9c06f07e-4e16-4045-ac99-305275364128 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] 10.222.0.79 "GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751" status: 200 len: 1358 microversion: 2.1 time: 0.262141 Apr 30 13:54:09.807635 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 871/1850] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:54:09 2021] GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751 => generated 1358 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:54:10.826226 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-2ccbb598-bfbc-4308-83e1-e94e3e413ff2 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:54:10.827078 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-2ccbb598-bfbc-4308-83e1-e94e3e413ff2 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] [instance: b732fd76-455b-4064-a885-31459b462751] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:54:10.835736 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2ccbb598-bfbc-4308-83e1-e94e3e413ff2 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:10.836271 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2ccbb598-bfbc-4308-83e1-e94e3e413ff2 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:10.837157 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2ccbb598-bfbc-4308-83e1-e94e3e413ff2 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:10.837655 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2ccbb598-bfbc-4308-83e1-e94e3e413ff2 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:11.090319 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-2ccbb598-bfbc-4308-83e1-e94e3e413ff2 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c8ea3509484601812bb4e1dd150439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbbf6d943814b7e84f6af3fb089971f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:54:11.099448 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-2ccbb598-bfbc-4308-83e1-e94e3e413ff2 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] 10.222.0.79 "GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751" status: 200 len: 1358 microversion: 2.1 time: 0.278166 Apr 30 13:54:11.100300 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 980/1851] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:54:10 2021] GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751 => generated 1358 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:54:11.476508 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [req-e7c31be3-3904-42a3-9353-3a7979b0745b req-f1edb6e8-b123-4965-863d-3838bd44ee7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b732fd76-455b-4064-a885-31459b462751", "name": "network-vif-plugged", "status": "completed", "tag": "6817d8b9-ec7d-40e5-a19f-7757ae2ef7b7"}]} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:54:11.478908 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:54:11.478908 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: warnings.warn(msg) Apr 30 13:54:11.489265 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-e7c31be3-3904-42a3-9353-3a7979b0745b req-f1edb6e8-b123-4965-863d-3838bd44ee7c service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:11.489792 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-e7c31be3-3904-42a3-9353-3a7979b0745b req-f1edb6e8-b123-4965-863d-3838bd44ee7c service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:11.507874 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.compute.server_external_events [req-e7c31be3-3904-42a3-9353-3a7979b0745b req-f1edb6e8-b123-4965-863d-3838bd44ee7c service nova] Creating event network-vif-plugged:6817d8b9-ec7d-40e5-a19f-7757ae2ef7b7 for instance b732fd76-455b-4064-a885-31459b462751 on hv-cinder-78836 Apr 30 13:54:11.513155 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [req-e7c31be3-3904-42a3-9353-3a7979b0745b req-f1edb6e8-b123-4965-863d-3838bd44ee7c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129938 Apr 30 13:54:11.513917 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 872/1852] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:54:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:54:12.116720 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-6ac45bae-4718-4ffb-b59a-d392c80aa806 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:54:12.117507 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-6ac45bae-4718-4ffb-b59a-d392c80aa806 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] [instance: b732fd76-455b-4064-a885-31459b462751] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:54:12.125554 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6ac45bae-4718-4ffb-b59a-d392c80aa806 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:12.126046 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6ac45bae-4718-4ffb-b59a-d392c80aa806 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:12.126855 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6ac45bae-4718-4ffb-b59a-d392c80aa806 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:12.127298 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6ac45bae-4718-4ffb-b59a-d392c80aa806 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:12.376487 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-6ac45bae-4718-4ffb-b59a-d392c80aa806 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c8ea3509484601812bb4e1dd150439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbbf6d943814b7e84f6af3fb089971f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:54:12.385892 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-6ac45bae-4718-4ffb-b59a-d392c80aa806 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] 10.222.0.79 "GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751" status: 200 len: 1358 microversion: 2.1 time: 0.273264 Apr 30 13:54:12.386503 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 981/1853] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:54:12 2021] GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751 => generated 1358 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:54:13.404435 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-54928433-30cb-4894-9e82-984d86af82ab tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:54:13.405125 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-54928433-30cb-4894-9e82-984d86af82ab tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] [instance: b732fd76-455b-4064-a885-31459b462751] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:54:13.413969 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-54928433-30cb-4894-9e82-984d86af82ab tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:13.414448 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-54928433-30cb-4894-9e82-984d86af82ab tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:13.415271 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-54928433-30cb-4894-9e82-984d86af82ab tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:13.415778 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-54928433-30cb-4894-9e82-984d86af82ab tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:13.649765 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-54928433-30cb-4894-9e82-984d86af82ab tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c8ea3509484601812bb4e1dd150439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbbf6d943814b7e84f6af3fb089971f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:54:13.660455 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-54928433-30cb-4894-9e82-984d86af82ab tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] 10.222.0.79 "GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751" status: 200 len: 1548 microversion: 2.1 time: 0.259582 Apr 30 13:54:13.661187 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 873/1854] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:54:13 2021] GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751 => generated 1548 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:54:13.682245 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-40a53d00-f89c-4e90-a8eb-feb825014d97 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:54:13.683372 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-40a53d00-f89c-4e90-a8eb-feb825014d97 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] [instance: b732fd76-455b-4064-a885-31459b462751] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:54:13.693488 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-40a53d00-f89c-4e90-a8eb-feb825014d97 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:13.694161 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-40a53d00-f89c-4e90-a8eb-feb825014d97 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:13.695476 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-40a53d00-f89c-4e90-a8eb-feb825014d97 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:13.696306 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-40a53d00-f89c-4e90-a8eb-feb825014d97 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:13.985555 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-40a53d00-f89c-4e90-a8eb-feb825014d97 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c8ea3509484601812bb4e1dd150439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbbf6d943814b7e84f6af3fb089971f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:54:13.995743 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-40a53d00-f89c-4e90-a8eb-feb825014d97 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] 10.222.0.79 "GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751" status: 200 len: 1548 microversion: 2.1 time: 0.318423 Apr 30 13:54:13.996333 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 982/1855] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:54:13 2021] GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751 => generated 1548 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:54:14.016290 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-83c6acec-276c-4065-b1e0-17b5807e9dcc tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:54:14.020904 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:54:14.020904 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: warnings.warn(msg) Apr 30 13:54:14.022050 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-83c6acec-276c-4065-b1e0-17b5807e9dcc tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f5c8ea3509484601812bb4e1dd150439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbbf6d943814b7e84f6af3fb089971f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:54:14.023078 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-83c6acec-276c-4065-b1e0-17b5807e9dcc tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Searching by: {'deleted': False, 'project_id': '7dbbf6d943814b7e84f6af3fb089971f'} {{(pid=87932) get_all /opt/stack/nova/nova/compute/api.py:2857}} Apr 30 13:54:14.029711 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-83c6acec-276c-4065-b1e0-17b5807e9dcc tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:14.030204 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-83c6acec-276c-4065-b1e0-17b5807e9dcc tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:14.031140 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-83c6acec-276c-4065-b1e0-17b5807e9dcc tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:14.031582 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-83c6acec-276c-4065-b1e0-17b5807e9dcc tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:14.151397 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.multi_cell_list [None req-83c6acec-276c-4065-b1e0-17b5807e9dcc tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=87932) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Apr 30 13:54:14.273103 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-83c6acec-276c-4065-b1e0-17b5807e9dcc tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.261207 Apr 30 13:54:14.273833 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 874/1856] 10.222.0.79 () {58 vars in 1125 bytes} [Fri Apr 30 13:54:14 2021] GET /compute/v2.1/servers => generated 342 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:54:14.284462 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-e80def87-f860-4c99-9153-d9e1db1db500 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:54:14.285655 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-e80def87-f860-4c99-9153-d9e1db1db500 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] [instance: b732fd76-455b-4064-a885-31459b462751] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:54:14.294185 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e80def87-f860-4c99-9153-d9e1db1db500 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:14.294959 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e80def87-f860-4c99-9153-d9e1db1db500 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:14.296201 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e80def87-f860-4c99-9153-d9e1db1db500 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:14.296779 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e80def87-f860-4c99-9153-d9e1db1db500 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:14.535335 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-e80def87-f860-4c99-9153-d9e1db1db500 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c8ea3509484601812bb4e1dd150439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbbf6d943814b7e84f6af3fb089971f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:54:14.545248 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-e80def87-f860-4c99-9153-d9e1db1db500 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] 10.222.0.79 "GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751" status: 200 len: 1548 microversion: 2.1 time: 0.264422 Apr 30 13:54:14.545851 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 983/1857] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:54:14 2021] GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751 => generated 1548 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:54:16.688507 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-65b63eab-82ec-43a5-b823-96a386e9b7a2 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2473b936-ea36-4a1f-ba5b-1263d63b369d"}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:54:16.689581 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-65b63eab-82ec-43a5-b823-96a386e9b7a2 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] [instance: b732fd76-455b-4064-a885-31459b462751] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:54:16.698029 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-65b63eab-82ec-43a5-b823-96a386e9b7a2 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:16.698493 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-65b63eab-82ec-43a5-b823-96a386e9b7a2 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:16.699506 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-65b63eab-82ec-43a5-b823-96a386e9b7a2 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:16.699957 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-65b63eab-82ec-43a5-b823-96a386e9b7a2 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:17.204296 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-65b63eab-82ec-43a5-b823-96a386e9b7a2 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] 10.222.0.79 "POST /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.519420 Apr 30 13:54:17.205333 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 875/1858] 10.222.0.79 () {60 vars in 1323 bytes} [Fri Apr 30 13:54:16 2021] POST /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751/os-volume_attachments => generated 194 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:54:25.441698 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-cc32b170-c461-4a26-8815-b6f2fe76edd1 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:54:25.442529 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-cc32b170-c461-4a26-8815-b6f2fe76edd1 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] [instance: b732fd76-455b-4064-a885-31459b462751] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:54:25.450512 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-cc32b170-c461-4a26-8815-b6f2fe76edd1 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:25.450963 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-cc32b170-c461-4a26-8815-b6f2fe76edd1 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:25.451761 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-cc32b170-c461-4a26-8815-b6f2fe76edd1 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:25.452202 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-cc32b170-c461-4a26-8815-b6f2fe76edd1 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:25.687943 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-cc32b170-c461-4a26-8815-b6f2fe76edd1 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c8ea3509484601812bb4e1dd150439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbbf6d943814b7e84f6af3fb089971f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:54:25.697643 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-cc32b170-c461-4a26-8815-b6f2fe76edd1 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] 10.222.0.79 "GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751" status: 200 len: 1594 microversion: 2.1 time: 0.260401 Apr 30 13:54:25.698313 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 984/1859] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:54:25 2021] GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751 => generated 1594 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:54:28.841801 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [req-6eea7688-12a3-445d-bf80-01ec045c82b9 req-8a8587e2-4c22-4ce3-8cd8-d950571b24d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b732fd76-455b-4064-a885-31459b462751", "tag": "6817d8b9-ec7d-40e5-a19f-7757ae2ef7b7"}]} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:54:28.845152 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:54:28.845152 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: warnings.warn(msg) Apr 30 13:54:28.869297 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-6eea7688-12a3-445d-bf80-01ec045c82b9 req-8a8587e2-4c22-4ce3-8cd8-d950571b24d5 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:28.870554 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-6eea7688-12a3-445d-bf80-01ec045c82b9 req-8a8587e2-4c22-4ce3-8cd8-d950571b24d5 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:28.900248 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.compute.server_external_events [req-6eea7688-12a3-445d-bf80-01ec045c82b9 req-8a8587e2-4c22-4ce3-8cd8-d950571b24d5 service nova] Creating event network-changed:6817d8b9-ec7d-40e5-a19f-7757ae2ef7b7 for instance b732fd76-455b-4064-a885-31459b462751 on hv-cinder-78836 Apr 30 13:54:28.908667 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [req-6eea7688-12a3-445d-bf80-01ec045c82b9 req-8a8587e2-4c22-4ce3-8cd8-d950571b24d5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163408 Apr 30 13:54:28.910512 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 876/1860] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:54:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:54:30.752632 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-640bc24c-c43c-4c8b-b8c6-dc74415993ea tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1469734020"}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:54:30.754080 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-640bc24c-c43c-4c8b-b8c6-dc74415993ea tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] [instance: b732fd76-455b-4064-a885-31459b462751] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:54:30.762945 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-640bc24c-c43c-4c8b-b8c6-dc74415993ea tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:30.763557 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-640bc24c-c43c-4c8b-b8c6-dc74415993ea tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:30.764456 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-640bc24c-c43c-4c8b-b8c6-dc74415993ea tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:30.764973 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-640bc24c-c43c-4c8b-b8c6-dc74415993ea tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:31.066751 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.network.security_group_api [None req-640bc24c-c43c-4c8b-b8c6-dc74415993ea tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Adding security group 83b975bf-6619-46b4-a09d-703dcbe578bf to port 6817d8b9-ec7d-40e5-a19f-7757ae2ef7b7 Apr 30 13:54:31.738709 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-640bc24c-c43c-4c8b-b8c6-dc74415993ea tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] 10.222.0.79 "POST /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751/action" status: 202 len: 0 microversion: 2.1 time: 0.989559 Apr 30 13:54:31.743829 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 985/1861] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:54:30 2021] POST /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751/action => generated 0 bytes in 993 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 13:54:31.771819 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [req-931b58fb-5100-444f-9c43-74bf0932a213 req-a1361ffb-79f2-44f9-87b6-140e476107df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b732fd76-455b-4064-a885-31459b462751", "tag": "6817d8b9-ec7d-40e5-a19f-7757ae2ef7b7"}]} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:54:31.772898 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-004c86c5-5511-43e5-9d48-05c487cd4236 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:54:31.777170 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-004c86c5-5511-43e5-9d48-05c487cd4236 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] [instance: b732fd76-455b-4064-a885-31459b462751] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:54:31.783748 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:54:31.783748 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: warnings.warn(msg) Apr 30 13:54:31.788257 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-004c86c5-5511-43e5-9d48-05c487cd4236 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:31.788726 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-004c86c5-5511-43e5-9d48-05c487cd4236 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:31.789538 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-004c86c5-5511-43e5-9d48-05c487cd4236 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:31.789985 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-004c86c5-5511-43e5-9d48-05c487cd4236 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:31.806835 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-931b58fb-5100-444f-9c43-74bf0932a213 req-a1361ffb-79f2-44f9-87b6-140e476107df service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:31.808363 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-931b58fb-5100-444f-9c43-74bf0932a213 req-a1361ffb-79f2-44f9-87b6-140e476107df service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:31.867593 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.compute.server_external_events [req-931b58fb-5100-444f-9c43-74bf0932a213 req-a1361ffb-79f2-44f9-87b6-140e476107df service nova] Creating event network-changed:6817d8b9-ec7d-40e5-a19f-7757ae2ef7b7 for instance b732fd76-455b-4064-a885-31459b462751 on hv-cinder-78836 Apr 30 13:54:31.909608 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [req-931b58fb-5100-444f-9c43-74bf0932a213 req-a1361ffb-79f2-44f9-87b6-140e476107df service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149504 Apr 30 13:54:31.912047 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 986/1862] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:54:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:54:32.543236 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-004c86c5-5511-43e5-9d48-05c487cd4236 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c8ea3509484601812bb4e1dd150439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbbf6d943814b7e84f6af3fb089971f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:54:32.557452 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-004c86c5-5511-43e5-9d48-05c487cd4236 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] 10.222.0.79 "GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751" status: 200 len: 1759 microversion: 2.1 time: 0.811337 Apr 30 13:54:32.558355 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 877/1863] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:54:31 2021] GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751 => generated 1759 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:54:46.543482 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-d93463ae-06da-43cf-9ebf-c7ce872891eb tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:54:46.544661 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-d93463ae-06da-43cf-9ebf-c7ce872891eb tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] [instance: b732fd76-455b-4064-a885-31459b462751] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:54:46.554639 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d93463ae-06da-43cf-9ebf-c7ce872891eb tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:46.555231 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d93463ae-06da-43cf-9ebf-c7ce872891eb tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:46.556389 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d93463ae-06da-43cf-9ebf-c7ce872891eb tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:46.557191 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-d93463ae-06da-43cf-9ebf-c7ce872891eb tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:46.720181 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-d93463ae-06da-43cf-9ebf-c7ce872891eb tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] 10.222.0.79 "POST /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751/action" status: 202 len: 0 microversion: 2.1 time: 0.180431 Apr 30 13:54:46.722039 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 987/1864] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:54:46 2021] POST /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 13:54:46.733257 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-cd0245a6-be94-4ed5-99b0-74a599480603 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:54:46.734227 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-cd0245a6-be94-4ed5-99b0-74a599480603 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] [instance: b732fd76-455b-4064-a885-31459b462751] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:54:46.747019 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cd0245a6-be94-4ed5-99b0-74a599480603 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:46.747782 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cd0245a6-be94-4ed5-99b0-74a599480603 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:46.748997 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cd0245a6-be94-4ed5-99b0-74a599480603 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:46.749673 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cd0245a6-be94-4ed5-99b0-74a599480603 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:47.186756 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-cd0245a6-be94-4ed5-99b0-74a599480603 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c8ea3509484601812bb4e1dd150439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbbf6d943814b7e84f6af3fb089971f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:54:47.206447 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-cd0245a6-be94-4ed5-99b0-74a599480603 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] 10.222.0.79 "GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751" status: 200 len: 1751 microversion: 2.1 time: 0.477659 Apr 30 13:54:47.207995 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 878/1865] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:54:46 2021] GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751 => generated 1751 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:54:48.279470 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-76b346eb-f0b2-462d-ae53-bd138103d038 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:54:48.280312 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-76b346eb-f0b2-462d-ae53-bd138103d038 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] [instance: b732fd76-455b-4064-a885-31459b462751] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:54:48.289756 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-76b346eb-f0b2-462d-ae53-bd138103d038 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:48.290238 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-76b346eb-f0b2-462d-ae53-bd138103d038 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:48.291458 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-76b346eb-f0b2-462d-ae53-bd138103d038 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:48.292131 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-76b346eb-f0b2-462d-ae53-bd138103d038 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:48.562281 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-76b346eb-f0b2-462d-ae53-bd138103d038 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c8ea3509484601812bb4e1dd150439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbbf6d943814b7e84f6af3fb089971f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:54:48.573575 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-76b346eb-f0b2-462d-ae53-bd138103d038 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] 10.222.0.79 "GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751" status: 200 len: 1756 microversion: 2.1 time: 0.298915 Apr 30 13:54:48.574182 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 988/1866] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:54:48 2021] GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751 => generated 1756 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:54:49.594633 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-23675941-d454-440b-8ed1-1196d75a514a tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:54:49.595225 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-23675941-d454-440b-8ed1-1196d75a514a tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] [instance: b732fd76-455b-4064-a885-31459b462751] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:54:49.603622 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-23675941-d454-440b-8ed1-1196d75a514a tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:49.604071 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-23675941-d454-440b-8ed1-1196d75a514a tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:49.604878 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-23675941-d454-440b-8ed1-1196d75a514a tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:49.605332 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-23675941-d454-440b-8ed1-1196d75a514a tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:49.905363 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-23675941-d454-440b-8ed1-1196d75a514a tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c8ea3509484601812bb4e1dd150439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbbf6d943814b7e84f6af3fb089971f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:54:49.917545 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-23675941-d454-440b-8ed1-1196d75a514a tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] 10.222.0.79 "GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751" status: 200 len: 1756 microversion: 2.1 time: 0.328273 Apr 30 13:54:49.918172 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 879/1867] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:54:49 2021] GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751 => generated 1756 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:54:50.941898 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-00c419a7-8700-4128-a98b-bb8e6f4aa203 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:54:50.943039 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-00c419a7-8700-4128-a98b-bb8e6f4aa203 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] [instance: b732fd76-455b-4064-a885-31459b462751] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:54:50.952423 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-00c419a7-8700-4128-a98b-bb8e6f4aa203 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:50.953008 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-00c419a7-8700-4128-a98b-bb8e6f4aa203 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:50.953897 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-00c419a7-8700-4128-a98b-bb8e6f4aa203 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:50.954473 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-00c419a7-8700-4128-a98b-bb8e6f4aa203 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:51.218049 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-00c419a7-8700-4128-a98b-bb8e6f4aa203 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c8ea3509484601812bb4e1dd150439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbbf6d943814b7e84f6af3fb089971f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:54:51.230985 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-00c419a7-8700-4128-a98b-bb8e6f4aa203 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] 10.222.0.79 "GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751" status: 200 len: 1756 microversion: 2.1 time: 0.295136 Apr 30 13:54:51.231696 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 989/1868] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:54:50 2021] GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751 => generated 1756 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:54:52.249311 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-2a4dfa7d-cf15-4457-83cf-3a9026361bc4 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:54:52.250277 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-2a4dfa7d-cf15-4457-83cf-3a9026361bc4 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] [instance: b732fd76-455b-4064-a885-31459b462751] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:54:52.258275 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2a4dfa7d-cf15-4457-83cf-3a9026361bc4 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:52.258731 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2a4dfa7d-cf15-4457-83cf-3a9026361bc4 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:52.259532 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2a4dfa7d-cf15-4457-83cf-3a9026361bc4 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:52.259975 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2a4dfa7d-cf15-4457-83cf-3a9026361bc4 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:52.530497 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-2a4dfa7d-cf15-4457-83cf-3a9026361bc4 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c8ea3509484601812bb4e1dd150439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbbf6d943814b7e84f6af3fb089971f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:54:52.546798 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-2a4dfa7d-cf15-4457-83cf-3a9026361bc4 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] 10.222.0.79 "GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751" status: 200 len: 1756 microversion: 2.1 time: 0.300864 Apr 30 13:54:52.547757 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 880/1869] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:54:52 2021] GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751 => generated 1756 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:54:53.570128 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b376d57e-a6a9-46d2-aa55-fb2b905d2226 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:54:53.571160 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-b376d57e-a6a9-46d2-aa55-fb2b905d2226 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] [instance: b732fd76-455b-4064-a885-31459b462751] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:54:53.585933 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b376d57e-a6a9-46d2-aa55-fb2b905d2226 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:53.586786 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b376d57e-a6a9-46d2-aa55-fb2b905d2226 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:53.588217 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b376d57e-a6a9-46d2-aa55-fb2b905d2226 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:53.589017 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b376d57e-a6a9-46d2-aa55-fb2b905d2226 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:53.892819 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-b376d57e-a6a9-46d2-aa55-fb2b905d2226 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c8ea3509484601812bb4e1dd150439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbbf6d943814b7e84f6af3fb089971f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:54:53.912729 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b376d57e-a6a9-46d2-aa55-fb2b905d2226 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] 10.222.0.79 "GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751" status: 200 len: 1756 microversion: 2.1 time: 0.349722 Apr 30 13:54:53.913999 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 990/1870] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:54:53 2021] GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751 => generated 1756 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:54:54.936162 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-a0b56d86-63be-4888-a3f1-0c0f295e6b09 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:54:54.936855 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-a0b56d86-63be-4888-a3f1-0c0f295e6b09 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] [instance: b732fd76-455b-4064-a885-31459b462751] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:54:54.952003 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a0b56d86-63be-4888-a3f1-0c0f295e6b09 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:54.952820 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a0b56d86-63be-4888-a3f1-0c0f295e6b09 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:54.953951 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a0b56d86-63be-4888-a3f1-0c0f295e6b09 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:54.954477 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a0b56d86-63be-4888-a3f1-0c0f295e6b09 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:55.211416 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-a0b56d86-63be-4888-a3f1-0c0f295e6b09 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c8ea3509484601812bb4e1dd150439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbbf6d943814b7e84f6af3fb089971f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:54:55.224861 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-a0b56d86-63be-4888-a3f1-0c0f295e6b09 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] 10.222.0.79 "GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751" status: 200 len: 1756 microversion: 2.1 time: 0.292623 Apr 30 13:54:55.225446 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 881/1871] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:54:54 2021] GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751 => generated 1756 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:54:56.246898 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-c6117df5-bfad-4a49-913a-97c17437bf97 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:54:56.247772 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-c6117df5-bfad-4a49-913a-97c17437bf97 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] [instance: b732fd76-455b-4064-a885-31459b462751] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:54:56.259162 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c6117df5-bfad-4a49-913a-97c17437bf97 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:56.259699 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c6117df5-bfad-4a49-913a-97c17437bf97 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:56.260764 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c6117df5-bfad-4a49-913a-97c17437bf97 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:56.261227 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c6117df5-bfad-4a49-913a-97c17437bf97 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:56.527143 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-c6117df5-bfad-4a49-913a-97c17437bf97 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c8ea3509484601812bb4e1dd150439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbbf6d943814b7e84f6af3fb089971f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:54:56.537533 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-c6117df5-bfad-4a49-913a-97c17437bf97 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] 10.222.0.79 "GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751" status: 200 len: 1756 microversion: 2.1 time: 0.297465 Apr 30 13:54:56.538305 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 991/1872] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:54:56 2021] GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751 => generated 1756 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:54:57.559618 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-200b9d83-48cb-47c9-aa8d-cf8ce0be419b tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:54:57.560605 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-200b9d83-48cb-47c9-aa8d-cf8ce0be419b tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] [instance: b732fd76-455b-4064-a885-31459b462751] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:54:57.571876 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-200b9d83-48cb-47c9-aa8d-cf8ce0be419b tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:57.572586 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-200b9d83-48cb-47c9-aa8d-cf8ce0be419b tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:57.573979 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-200b9d83-48cb-47c9-aa8d-cf8ce0be419b tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:57.574773 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-200b9d83-48cb-47c9-aa8d-cf8ce0be419b tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:57.848112 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-200b9d83-48cb-47c9-aa8d-cf8ce0be419b tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c8ea3509484601812bb4e1dd150439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbbf6d943814b7e84f6af3fb089971f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:54:57.857639 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-200b9d83-48cb-47c9-aa8d-cf8ce0be419b tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] 10.222.0.79 "GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751" status: 200 len: 1756 microversion: 2.1 time: 0.304173 Apr 30 13:54:57.858404 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 882/1873] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:54:57 2021] GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751 => generated 1756 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:54:58.880614 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-fe85dc4f-a0ee-4dae-9b0c-9d275e185a9b tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:54:58.881298 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-fe85dc4f-a0ee-4dae-9b0c-9d275e185a9b tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] [instance: b732fd76-455b-4064-a885-31459b462751] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:54:58.889778 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-fe85dc4f-a0ee-4dae-9b0c-9d275e185a9b tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:58.890335 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-fe85dc4f-a0ee-4dae-9b0c-9d275e185a9b tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:58.891186 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-fe85dc4f-a0ee-4dae-9b0c-9d275e185a9b tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:54:58.891678 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-fe85dc4f-a0ee-4dae-9b0c-9d275e185a9b tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:54:59.170245 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-fe85dc4f-a0ee-4dae-9b0c-9d275e185a9b tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c8ea3509484601812bb4e1dd150439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbbf6d943814b7e84f6af3fb089971f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:54:59.180894 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-fe85dc4f-a0ee-4dae-9b0c-9d275e185a9b tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] 10.222.0.79 "GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751" status: 200 len: 1756 microversion: 2.1 time: 0.304686 Apr 30 13:54:59.181538 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 992/1874] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:54:58 2021] GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751 => generated 1756 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:55:00.200079 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-5f9a3e3a-f8a5-4149-9e42-b0b7f67cb019 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:55:00.200875 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-5f9a3e3a-f8a5-4149-9e42-b0b7f67cb019 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] [instance: b732fd76-455b-4064-a885-31459b462751] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:55:00.211868 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5f9a3e3a-f8a5-4149-9e42-b0b7f67cb019 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:55:00.212661 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5f9a3e3a-f8a5-4149-9e42-b0b7f67cb019 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:55:00.213986 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5f9a3e3a-f8a5-4149-9e42-b0b7f67cb019 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:55:00.214787 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5f9a3e3a-f8a5-4149-9e42-b0b7f67cb019 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:55:00.481402 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-5f9a3e3a-f8a5-4149-9e42-b0b7f67cb019 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c8ea3509484601812bb4e1dd150439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbbf6d943814b7e84f6af3fb089971f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:55:00.493213 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-5f9a3e3a-f8a5-4149-9e42-b0b7f67cb019 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] 10.222.0.79 "GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751" status: 200 len: 1759 microversion: 2.1 time: 0.297142 Apr 30 13:55:00.493796 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 883/1875] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:55:00 2021] GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751 => generated 1759 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:55:06.804264 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:55:06.805021 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: Fri Apr 30 13:55:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:55:22.594032 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:55:22.595060 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: Fri Apr 30 13:55:22 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:55:32.739767 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-7b579d14-146d-4ddd-83f8-04a1a8f1db4e tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1469734020"}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:55:32.740742 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-7b579d14-146d-4ddd-83f8-04a1a8f1db4e tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] [instance: b732fd76-455b-4064-a885-31459b462751] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:55:32.748805 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7b579d14-146d-4ddd-83f8-04a1a8f1db4e tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:55:32.749329 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7b579d14-146d-4ddd-83f8-04a1a8f1db4e tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:55:32.750084 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7b579d14-146d-4ddd-83f8-04a1a8f1db4e tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:55:32.751125 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-7b579d14-146d-4ddd-83f8-04a1a8f1db4e tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:55:33.000649 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.network.security_group_api [None req-7b579d14-146d-4ddd-83f8-04a1a8f1db4e tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Removing security group 83b975bf-6619-46b4-a09d-703dcbe578bf from port 6817d8b9-ec7d-40e5-a19f-7757ae2ef7b7 Apr 30 13:55:33.737663 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-7b579d14-146d-4ddd-83f8-04a1a8f1db4e tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] 10.222.0.79 "POST /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751/action" status: 202 len: 0 microversion: 2.1 time: 1.000197 Apr 30 13:55:33.739535 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 993/1876] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Apr 30 13:55:32 2021] POST /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751/action => generated 0 bytes in 1008 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:55:33.752588 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [req-a8d614c7-6d31-4b80-bdb7-fc1f526fd60f req-94e43247-ec37-41c2-96e4-a2fb1df25c78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b732fd76-455b-4064-a885-31459b462751", "tag": "6817d8b9-ec7d-40e5-a19f-7757ae2ef7b7"}]} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:55:33.757295 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:55:33.757295 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: warnings.warn(msg) Apr 30 13:55:33.787472 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-a8d614c7-6d31-4b80-bdb7-fc1f526fd60f req-94e43247-ec37-41c2-96e4-a2fb1df25c78 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:55:33.789177 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-a8d614c7-6d31-4b80-bdb7-fc1f526fd60f req-94e43247-ec37-41c2-96e4-a2fb1df25c78 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:55:33.823545 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.compute.server_external_events [req-a8d614c7-6d31-4b80-bdb7-fc1f526fd60f req-94e43247-ec37-41c2-96e4-a2fb1df25c78 service nova] Creating event network-changed:6817d8b9-ec7d-40e5-a19f-7757ae2ef7b7 for instance b732fd76-455b-4064-a885-31459b462751 on hv-cinder-78836 Apr 30 13:55:33.831661 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [req-a8d614c7-6d31-4b80-bdb7-fc1f526fd60f req-94e43247-ec37-41c2-96e4-a2fb1df25c78 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094220 Apr 30 13:55:33.835118 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 884/1877] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:55:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:55:36.475961 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-eb8e6625-9e16-40db-bf9c-b1df2d1f2be0 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:55:36.476578 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-eb8e6625-9e16-40db-bf9c-b1df2d1f2be0 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] [instance: b732fd76-455b-4064-a885-31459b462751] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:55:36.481646 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [req-106e371e-25a2-4c48-8a8f-58686e9a0c60 req-096605ee-c91a-498f-a8a6-10057c0ce9de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b732fd76-455b-4064-a885-31459b462751", "tag": "6817d8b9-ec7d-40e5-a19f-7757ae2ef7b7"}]} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:55:36.484180 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:55:36.484180 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: warnings.warn(msg) Apr 30 13:55:36.487069 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-eb8e6625-9e16-40db-bf9c-b1df2d1f2be0 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:55:36.487878 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-eb8e6625-9e16-40db-bf9c-b1df2d1f2be0 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:55:36.489340 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-eb8e6625-9e16-40db-bf9c-b1df2d1f2be0 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:55:36.490047 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-eb8e6625-9e16-40db-bf9c-b1df2d1f2be0 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:55:36.498926 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-106e371e-25a2-4c48-8a8f-58686e9a0c60 req-096605ee-c91a-498f-a8a6-10057c0ce9de service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:55:36.499650 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-106e371e-25a2-4c48-8a8f-58686e9a0c60 req-096605ee-c91a-498f-a8a6-10057c0ce9de service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:55:36.528368 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.compute.server_external_events [req-106e371e-25a2-4c48-8a8f-58686e9a0c60 req-096605ee-c91a-498f-a8a6-10057c0ce9de service nova] Creating event network-changed:6817d8b9-ec7d-40e5-a19f-7757ae2ef7b7 for instance b732fd76-455b-4064-a885-31459b462751 on hv-cinder-78836 Apr 30 13:55:36.535363 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [req-106e371e-25a2-4c48-8a8f-58686e9a0c60 req-096605ee-c91a-498f-a8a6-10057c0ce9de service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060603 Apr 30 13:55:36.536494 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 885/1878] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:55:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:55:36.697348 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.objects.instance [None req-eb8e6625-9e16-40db-bf9c-b1df2d1f2be0 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lazy-loading 'services' on Instance uuid b732fd76-455b-4064-a885-31459b462751 {{(pid=87933) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:55:36.899925 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-eb8e6625-9e16-40db-bf9c-b1df2d1f2be0 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] 10.222.0.79 "DELETE /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751/os-volume_attachments/2473b936-ea36-4a1f-ba5b-1263d63b369d" status: 202 len: 0 microversion: 2.1 time: 0.428969 Apr 30 13:55:36.901548 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 994/1879] 10.222.0.79 () {58 vars in 1416 bytes} [Fri Apr 30 13:55:36 2021] DELETE /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751/os-volume_attachments/2473b936-ea36-4a1f-ba5b-1263d63b369d => generated 0 bytes in 433 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 30 13:55:36.922932 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-89203ab1-5e79-4496-9aea-e5d915a93aa8 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:55:36.925003 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-89203ab1-5e79-4496-9aea-e5d915a93aa8 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] [instance: b732fd76-455b-4064-a885-31459b462751] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:55:36.937194 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-89203ab1-5e79-4496-9aea-e5d915a93aa8 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:55:36.938150 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-89203ab1-5e79-4496-9aea-e5d915a93aa8 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:55:36.939640 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-89203ab1-5e79-4496-9aea-e5d915a93aa8 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:55:36.940262 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-89203ab1-5e79-4496-9aea-e5d915a93aa8 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:55:37.061245 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-89203ab1-5e79-4496-9aea-e5d915a93aa8 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] 10.222.0.79 "GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148537 Apr 30 13:55:37.068855 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 886/1880] 10.222.0.79 () {58 vars in 1302 bytes} [Fri Apr 30 13:55:36 2021] GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:55:38.082242 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-503d541e-8600-4df7-9919-b517ea86ca58 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:55:38.083914 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-503d541e-8600-4df7-9919-b517ea86ca58 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] [instance: b732fd76-455b-4064-a885-31459b462751] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:55:38.096769 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-503d541e-8600-4df7-9919-b517ea86ca58 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:55:38.097668 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-503d541e-8600-4df7-9919-b517ea86ca58 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:55:38.099036 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-503d541e-8600-4df7-9919-b517ea86ca58 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:55:38.099702 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-503d541e-8600-4df7-9919-b517ea86ca58 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:55:38.202480 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-503d541e-8600-4df7-9919-b517ea86ca58 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] 10.222.0.79 "GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.128751 Apr 30 13:55:38.203148 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 995/1881] 10.222.0.79 () {58 vars in 1302 bytes} [Fri Apr 30 13:55:38 2021] GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751/os-volume_attachments => generated 25 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 30 13:55:38.218466 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-ef2ce5f3-d0f5-4d67-bb56-875e8142b8b0 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:55:38.221401 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-ef2ce5f3-d0f5-4d67-bb56-875e8142b8b0 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] [instance: b732fd76-455b-4064-a885-31459b462751] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:55:38.229562 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ef2ce5f3-d0f5-4d67-bb56-875e8142b8b0 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:55:38.230128 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ef2ce5f3-d0f5-4d67-bb56-875e8142b8b0 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:55:38.231264 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ef2ce5f3-d0f5-4d67-bb56-875e8142b8b0 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:55:38.231943 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ef2ce5f3-d0f5-4d67-bb56-875e8142b8b0 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:55:38.476612 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.wsgi [None req-ef2ce5f3-d0f5-4d67-bb56-875e8142b8b0 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] HTTP exception thrown: Instance b732fd76-455b-4064-a885-31459b462751 is not attached to volume 2473b936-ea36-4a1f-ba5b-1263d63b369d Apr 30 13:55:38.477470 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-ef2ce5f3-d0f5-4d67-bb56-875e8142b8b0 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Returning 404 to user: Instance b732fd76-455b-4064-a885-31459b462751 is not attached to volume 2473b936-ea36-4a1f-ba5b-1263d63b369d {{(pid=87932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:55:38.478876 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-ef2ce5f3-d0f5-4d67-bb56-875e8142b8b0 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] 10.222.0.79 "DELETE /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751/os-volume_attachments/2473b936-ea36-4a1f-ba5b-1263d63b369d" status: 404 len: 154 microversion: 2.1 time: 0.265437 Apr 30 13:55:38.479529 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 887/1882] 10.222.0.79 () {58 vars in 1416 bytes} [Fri Apr 30 13:55:38 2021] DELETE /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751/os-volume_attachments/2473b936-ea36-4a1f-ba5b-1263d63b369d => generated 154 bytes in 267 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 13:55:39.821978 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-ed700305-22d5-4460-ae6c-c01dd3bdb329 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:55:39.822913 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-ed700305-22d5-4460-ae6c-c01dd3bdb329 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] [instance: b732fd76-455b-4064-a885-31459b462751] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:55:39.835194 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ed700305-22d5-4460-ae6c-c01dd3bdb329 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:55:39.835851 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ed700305-22d5-4460-ae6c-c01dd3bdb329 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:55:39.836791 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ed700305-22d5-4460-ae6c-c01dd3bdb329 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:55:39.837333 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ed700305-22d5-4460-ae6c-c01dd3bdb329 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:55:39.920233 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-ed700305-22d5-4460-ae6c-c01dd3bdb329 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] [instance: b732fd76-455b-4064-a885-31459b462751] Going to try to terminate instance {{(pid=87933) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 13:55:40.071433 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-ed700305-22d5-4460-ae6c-c01dd3bdb329 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] 10.222.0.79 "DELETE /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751" status: 204 len: 0 microversion: 2.1 time: 0.255579 Apr 30 13:55:40.072476 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 996/1883] 10.222.0.79 () {58 vars in 1239 bytes} [Fri Apr 30 13:55:39 2021] DELETE /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 13:55:40.085667 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-20914696-b6f3-4ade-ac28-707bbac4b637 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:55:40.086641 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-20914696-b6f3-4ade-ac28-707bbac4b637 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] [instance: b732fd76-455b-4064-a885-31459b462751] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:55:40.100184 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-20914696-b6f3-4ade-ac28-707bbac4b637 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:55:40.100833 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-20914696-b6f3-4ade-ac28-707bbac4b637 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:55:40.101982 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-20914696-b6f3-4ade-ac28-707bbac4b637 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:55:40.102819 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-20914696-b6f3-4ade-ac28-707bbac4b637 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:55:40.396216 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-20914696-b6f3-4ade-ac28-707bbac4b637 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c8ea3509484601812bb4e1dd150439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbbf6d943814b7e84f6af3fb089971f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:55:40.410703 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-20914696-b6f3-4ade-ac28-707bbac4b637 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] 10.222.0.79 "GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751" status: 200 len: 1554 microversion: 2.1 time: 0.332792 Apr 30 13:55:40.411637 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 888/1884] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:55:40 2021] GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751 => generated 1554 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:55:41.433307 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-2ccc450c-2ef8-475b-b506-74706453cb0c tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:55:41.434173 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-2ccc450c-2ef8-475b-b506-74706453cb0c tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] [instance: b732fd76-455b-4064-a885-31459b462751] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:55:41.442650 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2ccc450c-2ef8-475b-b506-74706453cb0c tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:55:41.443103 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2ccc450c-2ef8-475b-b506-74706453cb0c tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:55:41.443897 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2ccc450c-2ef8-475b-b506-74706453cb0c tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:55:41.444334 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2ccc450c-2ef8-475b-b506-74706453cb0c tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:55:41.720376 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-2ccc450c-2ef8-475b-b506-74706453cb0c tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c8ea3509484601812bb4e1dd150439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbbf6d943814b7e84f6af3fb089971f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:55:41.732695 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-2ccc450c-2ef8-475b-b506-74706453cb0c tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] 10.222.0.79 "GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751" status: 200 len: 1554 microversion: 2.1 time: 0.303460 Apr 30 13:55:41.733701 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 997/1885] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:55:41 2021] GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751 => generated 1554 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:55:42.761131 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-cf85fdfc-fa8a-4100-8ea8-18b94e00be92 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:55:42.761874 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-cf85fdfc-fa8a-4100-8ea8-18b94e00be92 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] [instance: b732fd76-455b-4064-a885-31459b462751] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:55:42.770277 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cf85fdfc-fa8a-4100-8ea8-18b94e00be92 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:55:42.770823 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cf85fdfc-fa8a-4100-8ea8-18b94e00be92 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:55:42.771981 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cf85fdfc-fa8a-4100-8ea8-18b94e00be92 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:55:42.772422 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-cf85fdfc-fa8a-4100-8ea8-18b94e00be92 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:55:42.981917 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-cf85fdfc-fa8a-4100-8ea8-18b94e00be92 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5c8ea3509484601812bb4e1dd150439', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dbbf6d943814b7e84f6af3fb089971f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:55:42.991455 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-cf85fdfc-fa8a-4100-8ea8-18b94e00be92 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] 10.222.0.79 "GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751" status: 200 len: 1512 microversion: 2.1 time: 0.233981 Apr 30 13:55:42.992038 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 889/1886] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:55:42 2021] GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751 => generated 1512 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:55:43.051803 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [req-ace844a6-daf1-46bf-b1ca-55ddf5526a0d req-aeb3858c-30c3-4a61-af0d-08d62ae54892 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b732fd76-455b-4064-a885-31459b462751", "name": "network-vif-deleted", "tag": "6817d8b9-ec7d-40e5-a19f-7757ae2ef7b7"}]} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:55:43.054629 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:55:43.054629 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: warnings.warn(msg) Apr 30 13:55:43.068042 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-ace844a6-daf1-46bf-b1ca-55ddf5526a0d req-aeb3858c-30c3-4a61-af0d-08d62ae54892 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:55:43.068281 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-ace844a6-daf1-46bf-b1ca-55ddf5526a0d req-aeb3858c-30c3-4a61-af0d-08d62ae54892 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:55:43.088720 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.compute.server_external_events [req-ace844a6-daf1-46bf-b1ca-55ddf5526a0d req-aeb3858c-30c3-4a61-af0d-08d62ae54892 service nova] Creating event network-vif-deleted:6817d8b9-ec7d-40e5-a19f-7757ae2ef7b7 for instance b732fd76-455b-4064-a885-31459b462751 on hv-cinder-78836 Apr 30 13:55:43.093697 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [req-ace844a6-daf1-46bf-b1ca-55ddf5526a0d req-aeb3858c-30c3-4a61-af0d-08d62ae54892 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046420 Apr 30 13:55:43.094943 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 998/1887] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:55:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:55:44.008959 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-b85c4b53-1ba0-4414-8452-da3f19b22e80 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:55:44.009607 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-b85c4b53-1ba0-4414-8452-da3f19b22e80 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] [instance: b732fd76-455b-4064-a885-31459b462751] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:55:44.018435 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b85c4b53-1ba0-4414-8452-da3f19b22e80 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:55:44.018967 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b85c4b53-1ba0-4414-8452-da3f19b22e80 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:55:44.019860 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b85c4b53-1ba0-4414-8452-da3f19b22e80 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:55:44.020404 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b85c4b53-1ba0-4414-8452-da3f19b22e80 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:55:44.077569 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.wsgi [None req-b85c4b53-1ba0-4414-8452-da3f19b22e80 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] HTTP exception thrown: Instance b732fd76-455b-4064-a885-31459b462751 could not be found. Apr 30 13:55:44.077569 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-b85c4b53-1ba0-4414-8452-da3f19b22e80 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Returning 404 to user: Instance b732fd76-455b-4064-a885-31459b462751 could not be found. {{(pid=87932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:55:44.079295 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-b85c4b53-1ba0-4414-8452-da3f19b22e80 tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] 10.222.0.79 "GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751" status: 404 len: 111 microversion: 2.1 time: 0.073442 Apr 30 13:55:44.079697 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 890/1888] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:55:44 2021] GET /compute/v2.1/servers/b732fd76-455b-4064-a885-31459b462751 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:55:44.092408 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-ccf0fc0c-cd70-4576-ac7e-8330509babcf tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] Calling method '.version_select at 0x7f74fb7d14c0>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:55:44.118772 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-ccf0fc0c-cd70-4576-ac7e-8330509babcf tempest-TestMinimumBasicScenario-73880698 tempest-TestMinimumBasicScenario-73880698-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2070195306" status: 202 len: 0 microversion: 2.1 time: 0.032584 Apr 30 13:55:44.119276 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 999/1889] 10.222.0.79 () {58 vars in 1272 bytes} [Fri Apr 30 13:55:44 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2070195306 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 13:56:20.837241 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-524c1293-20eb-4595-bf4b-53fc07e6151d tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Action: 'create', calling method: .version_select at 0x7f75001619d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1132199581"}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:56:20.882400 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.quota [None req-524c1293-20eb-4595-bf4b-53fc07e6151d tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Getting quotas for project 84f3c43c33604ba0889f52e0fc038af6. Resources: {'key_pairs'} {{(pid=87932) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:56:20.891451 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.quota [None req-524c1293-20eb-4595-bf4b-53fc07e6151d tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Getting quotas for user 29ea9144206a468fab90e65113903df0 and project 84f3c43c33604ba0889f52e0fc038af6. Resources: {'key_pairs'} {{(pid=87932) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:56:20.914553 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: ERROR oslo.messaging._drivers.impl_rabbit [None req-524c1293-20eb-4595-bf4b-53fc07e6151d tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [5aba4690-0fa5-42f5-9a2e-4891d6926397] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 30 13:56:21.942415 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO oslo.messaging._drivers.impl_rabbit [None req-524c1293-20eb-4595-bf4b-53fc07e6151d tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [5aba4690-0fa5-42f5-9a2e-4891d6926397] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 44500. Apr 30 13:56:22.125002 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.quota [None req-524c1293-20eb-4595-bf4b-53fc07e6151d tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Getting quotas for project 84f3c43c33604ba0889f52e0fc038af6. Resources: {'key_pairs'} {{(pid=87932) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:56:22.132962 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.quota [None req-524c1293-20eb-4595-bf4b-53fc07e6151d tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Getting quotas for user 29ea9144206a468fab90e65113903df0 and project 84f3c43c33604ba0889f52e0fc038af6. Resources: {'key_pairs'} {{(pid=87932) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:56:22.157268 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-524c1293-20eb-4595-bf4b-53fc07e6151d tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 1.597383 Apr 30 13:56:22.157996 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 891/1890] 10.222.0.79 () {60 vars in 1158 bytes} [Fri Apr 30 13:56:20 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:56:41.910595 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-91505d5a-4498-46bf-8630-77202df0aa81 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1309751281", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1132199581", "security_groups": [{"name": "tempest-secgroup-smoke-1144511476"}], "block_device_mapping_v2": [{"uuid": "677e7cef-4e86-41c1-be5b-c9fe288133b4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c9d9f60a-7ceb-4b5a-a2df-30f38a463f32"}]}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:56:42.129340 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.network.neutron [None req-91505d5a-4498-46bf-8630-77202df0aa81 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] validate_networks() for [('c9d9f60a-7ceb-4b5a-a2df-30f38a463f32', None, None, None)] {{(pid=87933) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 13:56:42.712581 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.virt.hardware [None req-91505d5a-4498-46bf-8630-77202df0aa81 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Flavor limits 0:0:0 {{(pid=87933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 13:56:42.713011 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.virt.hardware [None req-91505d5a-4498-46bf-8630-77202df0aa81 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Image limits 0:0:0 {{(pid=87933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 13:56:42.713527 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.virt.hardware [None req-91505d5a-4498-46bf-8630-77202df0aa81 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Flavor pref 0:0:0 {{(pid=87933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 13:56:42.713969 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.virt.hardware [None req-91505d5a-4498-46bf-8630-77202df0aa81 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Image pref 0:0:0 {{(pid=87933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 13:56:42.714418 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.virt.hardware [None req-91505d5a-4498-46bf-8630-77202df0aa81 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 13:56:42.723131 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-91505d5a-4498-46bf-8630-77202df0aa81 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:56:42.723590 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-91505d5a-4498-46bf-8630-77202df0aa81 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:56:42.724400 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-91505d5a-4498-46bf-8630-77202df0aa81 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:56:42.724844 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-91505d5a-4498-46bf-8630-77202df0aa81 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:56:42.742621 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.quota [None req-91505d5a-4498-46bf-8630-77202df0aa81 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Getting quotas for project 84f3c43c33604ba0889f52e0fc038af6. Resources: {'ram', 'instances', 'cores'} {{(pid=87933) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:56:42.747494 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.quota [None req-91505d5a-4498-46bf-8630-77202df0aa81 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Getting quotas for user 29ea9144206a468fab90e65113903df0 and project 84f3c43c33604ba0889f52e0fc038af6. Resources: {'ram', 'instances', 'cores'} {{(pid=87933) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:56:42.829327 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:56:42.829619 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: Fri Apr 30 13:56:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.79) !!! Apr 30 13:56:42.863639 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-91505d5a-4498-46bf-8630-77202df0aa81 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Going to run 1 instances... {{(pid=87933) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 13:56:42.865925 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-91505d5a-4498-46bf-8630-77202df0aa81 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 39664cb7-f41c-4aab-9708-827512370122] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='677e7cef-4e86-41c1-be5b-c9fe288133b4',volume_size=None,volume_type=None)] {{(pid=87933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 13:56:43.066232 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-91505d5a-4498-46bf-8630-77202df0aa81 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.159266 Apr 30 13:56:43.067725 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 1000/1891] 10.222.0.79 () {60 vars in 1147 bytes} [Fri Apr 30 13:56:41 2021] POST /compute/v2.1/servers => generated 406 bytes in 1162 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 13:56:43.077777 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-25bb788a-f363-401b-921f-64b38ca1effd tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:56:43.078341 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-25bb788a-f363-401b-921f-64b38ca1effd tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 39664cb7-f41c-4aab-9708-827512370122] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:56:43.246468 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-25bb788a-f363-401b-921f-64b38ca1effd tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:56:43.255143 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-25bb788a-f363-401b-921f-64b38ca1effd tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122" status: 200 len: 1095 microversion: 2.1 time: 0.182279 Apr 30 13:56:43.255743 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 892/1892] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:56:43 2021] GET /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122 => generated 1095 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:56:44.272937 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-c95f538b-8db1-4f7c-b0c4-cf71e1b03a63 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:56:44.273562 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-c95f538b-8db1-4f7c-b0c4-cf71e1b03a63 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 39664cb7-f41c-4aab-9708-827512370122] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:56:44.358995 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-c95f538b-8db1-4f7c-b0c4-cf71e1b03a63 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:56:44.367623 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-c95f538b-8db1-4f7c-b0c4-cf71e1b03a63 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122" status: 200 len: 1095 microversion: 2.1 time: 0.098743 Apr 30 13:56:44.368189 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 1001/1893] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:56:44 2021] GET /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122 => generated 1095 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:56:45.385322 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-b7b8e5a2-4215-4bb6-84b9-0490cbe5cdde tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:56:45.385942 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-b7b8e5a2-4215-4bb6-84b9-0490cbe5cdde tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 39664cb7-f41c-4aab-9708-827512370122] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:56:45.458658 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-b7b8e5a2-4215-4bb6-84b9-0490cbe5cdde tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:56:45.467542 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-b7b8e5a2-4215-4bb6-84b9-0490cbe5cdde tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122" status: 200 len: 1095 microversion: 2.1 time: 0.086074 Apr 30 13:56:45.468166 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 893/1894] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:56:45 2021] GET /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122 => generated 1095 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:56:46.485646 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-ef89a00c-52a1-46e8-8774-a6dda9c1b545 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:56:46.486313 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-ef89a00c-52a1-46e8-8774-a6dda9c1b545 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 39664cb7-f41c-4aab-9708-827512370122] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:56:46.563497 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-ef89a00c-52a1-46e8-8774-a6dda9c1b545 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:56:46.571736 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-ef89a00c-52a1-46e8-8774-a6dda9c1b545 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122" status: 200 len: 1095 microversion: 2.1 time: 0.090525 Apr 30 13:56:46.572319 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 1002/1895] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:56:46 2021] GET /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122 => generated 1095 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:56:47.589848 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-49a70bbf-d2ce-4c0a-a4b0-7b9d1829123a tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:56:47.590491 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-49a70bbf-d2ce-4c0a-a4b0-7b9d1829123a tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 39664cb7-f41c-4aab-9708-827512370122] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:56:47.597921 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-49a70bbf-d2ce-4c0a-a4b0-7b9d1829123a tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:56:47.598470 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-49a70bbf-d2ce-4c0a-a4b0-7b9d1829123a tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:56:47.599544 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-49a70bbf-d2ce-4c0a-a4b0-7b9d1829123a tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:56:47.600087 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-49a70bbf-d2ce-4c0a-a4b0-7b9d1829123a tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:56:47.746576 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-49a70bbf-d2ce-4c0a-a4b0-7b9d1829123a tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:56:47.756737 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-49a70bbf-d2ce-4c0a-a4b0-7b9d1829123a tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122" status: 200 len: 1145 microversion: 2.1 time: 0.171633 Apr 30 13:56:47.757648 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 894/1896] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:56:47 2021] GET /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122 => generated 1145 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:56:48.774887 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-4d064e2c-bf64-4bd0-83f4-8475f94bf793 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:56:48.775649 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-4d064e2c-bf64-4bd0-83f4-8475f94bf793 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 39664cb7-f41c-4aab-9708-827512370122] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:56:48.784638 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4d064e2c-bf64-4bd0-83f4-8475f94bf793 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:56:48.785090 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4d064e2c-bf64-4bd0-83f4-8475f94bf793 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:56:48.785900 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4d064e2c-bf64-4bd0-83f4-8475f94bf793 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:56:48.786358 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-4d064e2c-bf64-4bd0-83f4-8475f94bf793 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:56:48.939158 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-4d064e2c-bf64-4bd0-83f4-8475f94bf793 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:56:48.949648 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-4d064e2c-bf64-4bd0-83f4-8475f94bf793 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122" status: 200 len: 1211 microversion: 2.1 time: 0.178788 Apr 30 13:56:48.950265 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 1003/1897] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:56:48 2021] GET /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122 => generated 1211 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:56:49.968109 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-ca6d7a57-f5bb-4e38-91a4-dd4bd63a39b5 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:56:49.969013 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-ca6d7a57-f5bb-4e38-91a4-dd4bd63a39b5 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 39664cb7-f41c-4aab-9708-827512370122] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:56:49.976710 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ca6d7a57-f5bb-4e38-91a4-dd4bd63a39b5 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:56:49.977250 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ca6d7a57-f5bb-4e38-91a4-dd4bd63a39b5 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:56:49.978187 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ca6d7a57-f5bb-4e38-91a4-dd4bd63a39b5 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:56:49.978744 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ca6d7a57-f5bb-4e38-91a4-dd4bd63a39b5 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:56:50.579965 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-ca6d7a57-f5bb-4e38-91a4-dd4bd63a39b5 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:56:50.601480 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-ca6d7a57-f5bb-4e38-91a4-dd4bd63a39b5 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122" status: 200 len: 1267 microversion: 2.1 time: 0.637256 Apr 30 13:56:50.602544 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 895/1898] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:56:49 2021] GET /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122 => generated 1267 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:56:50.704574 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [req-2773bbab-9922-4601-802d-bba76a77fb97 req-d5efa62c-c028-42c4-b879-02582dc3d201 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39664cb7-f41c-4aab-9708-827512370122", "tag": "1a417599-01f3-411c-81f8-a1f6c6c4c06b"}]} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:56:50.706728 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:56:50.706728 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: warnings.warn(msg) Apr 30 13:56:50.719502 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-2773bbab-9922-4601-802d-bba76a77fb97 req-d5efa62c-c028-42c4-b879-02582dc3d201 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:56:50.720035 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-2773bbab-9922-4601-802d-bba76a77fb97 req-d5efa62c-c028-42c4-b879-02582dc3d201 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:56:50.743656 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.compute.server_external_events [req-2773bbab-9922-4601-802d-bba76a77fb97 req-d5efa62c-c028-42c4-b879-02582dc3d201 service nova] Creating event network-changed:1a417599-01f3-411c-81f8-a1f6c6c4c06b for instance 39664cb7-f41c-4aab-9708-827512370122 on hv-cinder-78836 Apr 30 13:56:50.751195 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [req-2773bbab-9922-4601-802d-bba76a77fb97 req-d5efa62c-c028-42c4-b879-02582dc3d201 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057064 Apr 30 13:56:50.751985 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 1004/1899] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:56:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:56:51.627695 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-70543282-5caf-4fd3-945f-20043cc568ba tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:56:51.628391 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-70543282-5caf-4fd3-945f-20043cc568ba tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 39664cb7-f41c-4aab-9708-827512370122] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:56:51.640861 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-70543282-5caf-4fd3-945f-20043cc568ba tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:56:51.641583 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-70543282-5caf-4fd3-945f-20043cc568ba tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:56:51.642551 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-70543282-5caf-4fd3-945f-20043cc568ba tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:56:51.643112 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-70543282-5caf-4fd3-945f-20043cc568ba tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:56:52.078271 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-70543282-5caf-4fd3-945f-20043cc568ba tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:56:52.091882 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-70543282-5caf-4fd3-945f-20043cc568ba tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122" status: 200 len: 1267 microversion: 2.1 time: 0.468194 Apr 30 13:56:52.092689 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 896/1900] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:56:51 2021] GET /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122 => generated 1267 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:56:53.112275 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-6f9af59a-f972-4cbe-a945-8fd3016e6a5c tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:56:53.113142 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-6f9af59a-f972-4cbe-a945-8fd3016e6a5c tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 39664cb7-f41c-4aab-9708-827512370122] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:56:53.118333 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb5a7899-1fdb-42b6-bec0-d69e54b8f5a6] AMQP server on 10.222.0.79:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 13:56:53.125903 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6f9af59a-f972-4cbe-a945-8fd3016e6a5c tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:56:53.126407 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6f9af59a-f972-4cbe-a945-8fd3016e6a5c tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:56:53.127469 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6f9af59a-f972-4cbe-a945-8fd3016e6a5c tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:56:53.127969 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-6f9af59a-f972-4cbe-a945-8fd3016e6a5c tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:56:53.365275 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-6f9af59a-f972-4cbe-a945-8fd3016e6a5c tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:56:53.374000 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-6f9af59a-f972-4cbe-a945-8fd3016e6a5c tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122" status: 200 len: 1267 microversion: 2.1 time: 0.266748 Apr 30 13:56:53.375184 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 1005/1901] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:56:53 2021] GET /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122 => generated 1267 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:56:54.399590 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-212935ca-5097-43af-9293-9db5fd800c62 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:56:54.400175 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-212935ca-5097-43af-9293-9db5fd800c62 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 39664cb7-f41c-4aab-9708-827512370122] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:56:54.408820 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-212935ca-5097-43af-9293-9db5fd800c62 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:56:54.409270 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-212935ca-5097-43af-9293-9db5fd800c62 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:56:54.410433 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-212935ca-5097-43af-9293-9db5fd800c62 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:56:54.410870 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-212935ca-5097-43af-9293-9db5fd800c62 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:56:54.623994 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-212935ca-5097-43af-9293-9db5fd800c62 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:56:54.632813 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-212935ca-5097-43af-9293-9db5fd800c62 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122" status: 200 len: 1267 microversion: 2.1 time: 0.237199 Apr 30 13:56:54.633380 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 897/1902] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:56:54 2021] GET /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122 => generated 1267 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:56:55.654452 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-86f02c48-79f2-446e-9f49-343a9faf4731 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:56:55.655543 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-86f02c48-79f2-446e-9f49-343a9faf4731 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 39664cb7-f41c-4aab-9708-827512370122] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:56:55.678938 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-86f02c48-79f2-446e-9f49-343a9faf4731 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:56:55.679870 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-86f02c48-79f2-446e-9f49-343a9faf4731 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:56:55.680108 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-86f02c48-79f2-446e-9f49-343a9faf4731 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:56:55.680500 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-86f02c48-79f2-446e-9f49-343a9faf4731 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:56:55.737989 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb5a7899-1fdb-42b6-bec0-d69e54b8f5a6] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 44696. Apr 30 13:56:55.918684 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-86f02c48-79f2-446e-9f49-343a9faf4731 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:56:55.928066 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-86f02c48-79f2-446e-9f49-343a9faf4731 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122" status: 200 len: 1267 microversion: 2.1 time: 0.280499 Apr 30 13:56:55.928641 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 1006/1903] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:56:55 2021] GET /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122 => generated 1267 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:56:56.948235 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-62e6f3df-5868-4c04-babf-bd20a185823a tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:56:56.948997 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-62e6f3df-5868-4c04-babf-bd20a185823a tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 39664cb7-f41c-4aab-9708-827512370122] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:56:56.959627 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-62e6f3df-5868-4c04-babf-bd20a185823a tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:56:56.960423 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-62e6f3df-5868-4c04-babf-bd20a185823a tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:56:56.961761 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-62e6f3df-5868-4c04-babf-bd20a185823a tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:56:56.962537 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-62e6f3df-5868-4c04-babf-bd20a185823a tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:56:57.234583 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-62e6f3df-5868-4c04-babf-bd20a185823a tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:56:57.243624 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-62e6f3df-5868-4c04-babf-bd20a185823a tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122" status: 200 len: 1267 microversion: 2.1 time: 0.299469 Apr 30 13:56:57.244230 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 898/1904] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:56:56 2021] GET /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122 => generated 1267 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:56:58.263129 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-ad6c3a91-f9c6-40ec-88f7-a66111ddc13f tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:56:58.263818 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-ad6c3a91-f9c6-40ec-88f7-a66111ddc13f tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 39664cb7-f41c-4aab-9708-827512370122] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:56:58.271540 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ad6c3a91-f9c6-40ec-88f7-a66111ddc13f tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:56:58.271985 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ad6c3a91-f9c6-40ec-88f7-a66111ddc13f tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:56:58.272763 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ad6c3a91-f9c6-40ec-88f7-a66111ddc13f tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:56:58.273203 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ad6c3a91-f9c6-40ec-88f7-a66111ddc13f tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:56:58.487295 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-ad6c3a91-f9c6-40ec-88f7-a66111ddc13f tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:56:58.498939 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-ad6c3a91-f9c6-40ec-88f7-a66111ddc13f tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122" status: 200 len: 1267 microversion: 2.1 time: 0.239432 Apr 30 13:56:58.499726 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 1007/1905] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:56:58 2021] GET /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122 => generated 1267 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:56:59.518625 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-2c249272-c644-456d-a26b-f0840ee05d52 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:56:59.519249 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-2c249272-c644-456d-a26b-f0840ee05d52 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 39664cb7-f41c-4aab-9708-827512370122] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:56:59.529716 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2c249272-c644-456d-a26b-f0840ee05d52 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:56:59.530200 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2c249272-c644-456d-a26b-f0840ee05d52 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:56:59.530989 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2c249272-c644-456d-a26b-f0840ee05d52 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:56:59.531422 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-2c249272-c644-456d-a26b-f0840ee05d52 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:56:59.751093 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-2c249272-c644-456d-a26b-f0840ee05d52 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:56:59.759724 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-2c249272-c644-456d-a26b-f0840ee05d52 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122" status: 200 len: 1267 microversion: 2.1 time: 0.246601 Apr 30 13:56:59.760303 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 899/1906] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:56:59 2021] GET /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122 => generated 1267 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:57:00.778191 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-3db62ece-0e65-43c2-a3a9-4fa9a40d0c70 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:57:00.778940 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-3db62ece-0e65-43c2-a3a9-4fa9a40d0c70 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 39664cb7-f41c-4aab-9708-827512370122] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:57:00.786918 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3db62ece-0e65-43c2-a3a9-4fa9a40d0c70 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:57:00.787376 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3db62ece-0e65-43c2-a3a9-4fa9a40d0c70 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:57:00.788167 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3db62ece-0e65-43c2-a3a9-4fa9a40d0c70 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:57:00.788610 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3db62ece-0e65-43c2-a3a9-4fa9a40d0c70 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:57:01.020639 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-3db62ece-0e65-43c2-a3a9-4fa9a40d0c70 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:57:01.031644 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-3db62ece-0e65-43c2-a3a9-4fa9a40d0c70 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122" status: 200 len: 1267 microversion: 2.1 time: 0.257334 Apr 30 13:57:01.032181 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 1008/1907] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:57:00 2021] GET /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122 => generated 1267 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:57:02.050870 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-0699111d-75f7-4ca6-80fd-b87d611c119e tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:57:02.051937 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-0699111d-75f7-4ca6-80fd-b87d611c119e tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 39664cb7-f41c-4aab-9708-827512370122] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:57:02.063212 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0699111d-75f7-4ca6-80fd-b87d611c119e tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:57:02.063556 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [req-76221e99-b5e4-49c5-a240-1e349c0d8ec4 req-151b048e-1cb2-4df3-bf58-2f51632af206 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39664cb7-f41c-4aab-9708-827512370122", "name": "network-vif-plugged", "status": "completed", "tag": "1a417599-01f3-411c-81f8-a1f6c6c4c06b"}]} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:57:02.064051 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0699111d-75f7-4ca6-80fd-b87d611c119e tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:57:02.065244 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0699111d-75f7-4ca6-80fd-b87d611c119e tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:57:02.065930 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-0699111d-75f7-4ca6-80fd-b87d611c119e tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:57:02.066139 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:57:02.066139 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: warnings.warn(msg) Apr 30 13:57:02.075997 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-76221e99-b5e4-49c5-a240-1e349c0d8ec4 req-151b048e-1cb2-4df3-bf58-2f51632af206 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:57:02.076676 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-76221e99-b5e4-49c5-a240-1e349c0d8ec4 req-151b048e-1cb2-4df3-bf58-2f51632af206 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:57:02.097097 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.compute.server_external_events [req-76221e99-b5e4-49c5-a240-1e349c0d8ec4 req-151b048e-1cb2-4df3-bf58-2f51632af206 service nova] Creating event network-vif-plugged:1a417599-01f3-411c-81f8-a1f6c6c4c06b for instance 39664cb7-f41c-4aab-9708-827512370122 on hv-cinder-78836 Apr 30 13:57:02.102748 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [req-76221e99-b5e4-49c5-a240-1e349c0d8ec4 req-151b048e-1cb2-4df3-bf58-2f51632af206 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046049 Apr 30 13:57:02.103539 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 1009/1908] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:57:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 13:57:02.344935 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-0699111d-75f7-4ca6-80fd-b87d611c119e tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:57:02.361963 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-0699111d-75f7-4ca6-80fd-b87d611c119e tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122" status: 200 len: 1267 microversion: 2.1 time: 0.316185 Apr 30 13:57:02.362582 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 900/1909] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:57:02 2021] GET /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122 => generated 1267 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:57:03.380996 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-726defa8-0612-4aad-873d-390e32c5d7e4 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:57:03.381692 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-726defa8-0612-4aad-873d-390e32c5d7e4 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 39664cb7-f41c-4aab-9708-827512370122] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:57:03.392334 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-726defa8-0612-4aad-873d-390e32c5d7e4 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:57:03.392790 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-726defa8-0612-4aad-873d-390e32c5d7e4 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:57:03.393593 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-726defa8-0612-4aad-873d-390e32c5d7e4 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:57:03.394061 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-726defa8-0612-4aad-873d-390e32c5d7e4 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:57:03.643779 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-726defa8-0612-4aad-873d-390e32c5d7e4 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:57:03.655041 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-726defa8-0612-4aad-873d-390e32c5d7e4 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122" status: 200 len: 1267 microversion: 2.1 time: 0.278083 Apr 30 13:57:03.655640 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 1010/1910] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:57:03 2021] GET /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122 => generated 1267 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:57:04.675676 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-1e45eaa7-3be1-412e-8f8b-ec60137c990e tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:57:04.676759 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-1e45eaa7-3be1-412e-8f8b-ec60137c990e tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 39664cb7-f41c-4aab-9708-827512370122] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:57:04.690039 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1e45eaa7-3be1-412e-8f8b-ec60137c990e tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:57:04.690771 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1e45eaa7-3be1-412e-8f8b-ec60137c990e tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:57:04.692135 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1e45eaa7-3be1-412e-8f8b-ec60137c990e tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:57:04.692875 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1e45eaa7-3be1-412e-8f8b-ec60137c990e tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:57:04.965265 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-1e45eaa7-3be1-412e-8f8b-ec60137c990e tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:57:04.974934 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-1e45eaa7-3be1-412e-8f8b-ec60137c990e tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122" status: 200 len: 1455 microversion: 2.1 time: 0.306625 Apr 30 13:57:04.975535 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 901/1911] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:57:04 2021] GET /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122 => generated 1455 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:57:04.996608 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-609532d4-a1be-4b6d-a56d-815990ff992c tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:57:04.997414 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-609532d4-a1be-4b6d-a56d-815990ff992c tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 39664cb7-f41c-4aab-9708-827512370122] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:57:05.005310 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-609532d4-a1be-4b6d-a56d-815990ff992c tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:57:05.005767 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-609532d4-a1be-4b6d-a56d-815990ff992c tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:57:05.006696 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-609532d4-a1be-4b6d-a56d-815990ff992c tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:57:05.007064 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-609532d4-a1be-4b6d-a56d-815990ff992c tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:57:05.255772 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-609532d4-a1be-4b6d-a56d-815990ff992c tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:57:05.266241 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-609532d4-a1be-4b6d-a56d-815990ff992c tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122" status: 200 len: 1455 microversion: 2.1 time: 0.275965 Apr 30 13:57:05.266856 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 1011/1912] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:57:04 2021] GET /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122 => generated 1455 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:57:08.289031 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [req-bd161488-a378-4b61-b092-492b5b1725af req-f73d8b6f-d20f-443e-bfaf-bc8492b9127c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39664cb7-f41c-4aab-9708-827512370122", "tag": "1a417599-01f3-411c-81f8-a1f6c6c4c06b"}]} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:57:08.290593 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:57:08.290593 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: warnings.warn(msg) Apr 30 13:57:08.300282 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-bd161488-a378-4b61-b092-492b5b1725af req-f73d8b6f-d20f-443e-bfaf-bc8492b9127c service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:57:08.300729 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-bd161488-a378-4b61-b092-492b5b1725af req-f73d8b6f-d20f-443e-bfaf-bc8492b9127c service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:57:08.320249 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.compute.server_external_events [req-bd161488-a378-4b61-b092-492b5b1725af req-f73d8b6f-d20f-443e-bfaf-bc8492b9127c service nova] Creating event network-changed:1a417599-01f3-411c-81f8-a1f6c6c4c06b for instance 39664cb7-f41c-4aab-9708-827512370122 on hv-cinder-78836 Apr 30 13:57:08.330526 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [req-bd161488-a378-4b61-b092-492b5b1725af req-f73d8b6f-d20f-443e-bfaf-bc8492b9127c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045115 Apr 30 13:57:08.331691 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 902/1913] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:57:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:58:26.835918 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:58:26.836988 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: Fri Apr 30 13:58:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:58:42.615824 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 13:58:42.616696 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: Fri Apr 30 13:58:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 13:58:58.060394 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b8243441-e01e-4a35-971d-f565b27bfb5a tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:58:58.061448 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-b8243441-e01e-4a35-971d-f565b27bfb5a tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 39664cb7-f41c-4aab-9708-827512370122] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:58:58.075555 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b8243441-e01e-4a35-971d-f565b27bfb5a tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:58:58.076351 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b8243441-e01e-4a35-971d-f565b27bfb5a tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:58:58.077757 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b8243441-e01e-4a35-971d-f565b27bfb5a tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:58:58.078571 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b8243441-e01e-4a35-971d-f565b27bfb5a tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:58:58.208106 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-b8243441-e01e-4a35-971d-f565b27bfb5a tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 39664cb7-f41c-4aab-9708-827512370122] Going to try to terminate instance {{(pid=87933) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 13:58:58.407414 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b8243441-e01e-4a35-971d-f565b27bfb5a tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "DELETE /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122" status: 204 len: 0 microversion: 2.1 time: 0.353775 Apr 30 13:58:58.408521 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 1012/1914] 10.222.0.79 () {58 vars in 1239 bytes} [Fri Apr 30 13:58:58 2021] DELETE /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 13:58:58.418088 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1abdcfbc-0fea-4857-8557-cdc275d2ef0c] AMQP server on 10.222.0.79:5672 is unreachable: Server unexpectedly closed connection. Trying again in 1 seconds.: OSError: Server unexpectedly closed connection Apr 30 13:58:58.423525 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-1e511051-691a-4324-92e7-be6633b31173 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:58:58.424828 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-1e511051-691a-4324-92e7-be6633b31173 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 39664cb7-f41c-4aab-9708-827512370122] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:58:58.440452 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1e511051-691a-4324-92e7-be6633b31173 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:58:58.441171 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1e511051-691a-4324-92e7-be6633b31173 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:58:58.442631 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1e511051-691a-4324-92e7-be6633b31173 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:58:58.443393 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-1e511051-691a-4324-92e7-be6633b31173 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:58:58.956247 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-1e511051-691a-4324-92e7-be6633b31173 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:58:58.968526 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-1e511051-691a-4324-92e7-be6633b31173 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122" status: 200 len: 1580 microversion: 2.1 time: 0.552431 Apr 30 13:58:58.969393 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 903/1915] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:58:58 2021] GET /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122 => generated 1580 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:58:59.998807 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-83e1ce7b-523e-4eb9-a0aa-264adc2e4386 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:59:00.000123 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-83e1ce7b-523e-4eb9-a0aa-264adc2e4386 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 39664cb7-f41c-4aab-9708-827512370122] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:59:00.014177 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-83e1ce7b-523e-4eb9-a0aa-264adc2e4386 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:59:00.015014 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-83e1ce7b-523e-4eb9-a0aa-264adc2e4386 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:59:00.016440 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-83e1ce7b-523e-4eb9-a0aa-264adc2e4386 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:59:00.017254 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-83e1ce7b-523e-4eb9-a0aa-264adc2e4386 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:59:00.474787 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-83e1ce7b-523e-4eb9-a0aa-264adc2e4386 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:59:00.484543 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-83e1ce7b-523e-4eb9-a0aa-264adc2e4386 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122" status: 200 len: 1580 microversion: 2.1 time: 0.495554 Apr 30 13:59:00.485322 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 1013/1916] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:58:59 2021] GET /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122 => generated 1580 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:59:01.506275 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-13bb92ea-e089-40c1-9508-2ae3bc9095f4 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:59:01.507256 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-13bb92ea-e089-40c1-9508-2ae3bc9095f4 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 39664cb7-f41c-4aab-9708-827512370122] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:59:01.546739 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-13bb92ea-e089-40c1-9508-2ae3bc9095f4 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:59:01.547742 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-13bb92ea-e089-40c1-9508-2ae3bc9095f4 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:59:01.548918 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-13bb92ea-e089-40c1-9508-2ae3bc9095f4 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:59:01.549684 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-13bb92ea-e089-40c1-9508-2ae3bc9095f4 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:59:01.658220 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO oslo.messaging._drivers.impl_rabbit [-] [1abdcfbc-0fea-4857-8557-cdc275d2ef0c] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 44766. Apr 30 13:59:01.879478 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-13bb92ea-e089-40c1-9508-2ae3bc9095f4 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:59:01.893811 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-13bb92ea-e089-40c1-9508-2ae3bc9095f4 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122" status: 200 len: 1512 microversion: 2.1 time: 0.392621 Apr 30 13:59:01.895834 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 904/1917] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:59:01 2021] GET /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122 => generated 1512 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:59:02.310154 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [req-e0c9ca44-1c0f-4fb4-acae-496d2cb37e6a req-13db770d-1822-4d63-acd5-688d1d3faaf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39664cb7-f41c-4aab-9708-827512370122", "name": "network-vif-deleted", "tag": "1a417599-01f3-411c-81f8-a1f6c6c4c06b"}]} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:59:02.313226 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:59:02.313226 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: warnings.warn(msg) Apr 30 13:59:02.330250 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-e0c9ca44-1c0f-4fb4-acae-496d2cb37e6a req-13db770d-1822-4d63-acd5-688d1d3faaf7 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:59:02.330963 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-e0c9ca44-1c0f-4fb4-acae-496d2cb37e6a req-13db770d-1822-4d63-acd5-688d1d3faaf7 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:59:02.363047 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.compute.server_external_events [req-e0c9ca44-1c0f-4fb4-acae-496d2cb37e6a req-13db770d-1822-4d63-acd5-688d1d3faaf7 service nova] Creating event network-vif-deleted:1a417599-01f3-411c-81f8-a1f6c6c4c06b for instance 39664cb7-f41c-4aab-9708-827512370122 on hv-cinder-78836 Apr 30 13:59:02.372557 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [req-e0c9ca44-1c0f-4fb4-acae-496d2cb37e6a req-13db770d-1822-4d63-acd5-688d1d3faaf7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068836 Apr 30 13:59:02.373777 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 1014/1918] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:59:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:59:02.922572 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-5b303ba1-ecec-415b-b7b0-f438ed7f7704 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:59:02.923874 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-5b303ba1-ecec-415b-b7b0-f438ed7f7704 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 39664cb7-f41c-4aab-9708-827512370122] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:59:02.937092 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5b303ba1-ecec-415b-b7b0-f438ed7f7704 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:59:02.937873 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5b303ba1-ecec-415b-b7b0-f438ed7f7704 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:59:02.939223 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5b303ba1-ecec-415b-b7b0-f438ed7f7704 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:59:02.939915 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5b303ba1-ecec-415b-b7b0-f438ed7f7704 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:59:03.045226 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5b303ba1-ecec-415b-b7b0-f438ed7f7704 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:59:03.045945 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-5b303ba1-ecec-415b-b7b0-f438ed7f7704 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:59:03.046600 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.objects.instance [None req-5b303ba1-ecec-415b-b7b0-f438ed7f7704 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lazy-loading 'fault' on Instance uuid 39664cb7-f41c-4aab-9708-827512370122 {{(pid=87932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Apr 30 13:59:03.138819 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-5b303ba1-ecec-415b-b7b0-f438ed7f7704 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:59:03.152226 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-5b303ba1-ecec-415b-b7b0-f438ed7f7704 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122" status: 200 len: 1231 microversion: 2.1 time: 0.234869 Apr 30 13:59:03.153547 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 905/1919] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:59:02 2021] GET /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122 => generated 1231 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:59:04.184108 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-3e3fec33-cd0c-453c-a23f-160184de0269 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:59:04.185470 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-3e3fec33-cd0c-453c-a23f-160184de0269 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 39664cb7-f41c-4aab-9708-827512370122] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:59:04.201386 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3e3fec33-cd0c-453c-a23f-160184de0269 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:59:04.202247 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3e3fec33-cd0c-453c-a23f-160184de0269 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:59:04.204035 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3e3fec33-cd0c-453c-a23f-160184de0269 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:59:04.204881 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-3e3fec33-cd0c-453c-a23f-160184de0269 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:59:04.293199 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.wsgi [None req-3e3fec33-cd0c-453c-a23f-160184de0269 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] HTTP exception thrown: Instance 39664cb7-f41c-4aab-9708-827512370122 could not be found. Apr 30 13:59:04.294389 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-3e3fec33-cd0c-453c-a23f-160184de0269 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Returning 404 to user: Instance 39664cb7-f41c-4aab-9708-827512370122 could not be found. {{(pid=87933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 13:59:04.295750 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-3e3fec33-cd0c-453c-a23f-160184de0269 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122" status: 404 len: 111 microversion: 2.1 time: 0.120116 Apr 30 13:59:04.297792 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 1015/1920] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:59:04 2021] GET /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 13:59:04.528819 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-480da6cb-80c8-490a-b6d2-064d97fb8312 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1817102214", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1132199581", "security_groups": [{"name": "tempest-secgroup-smoke-1144511476"}], "block_device_mapping_v2": [{"uuid": "677e7cef-4e86-41c1-be5b-c9fe288133b4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c9d9f60a-7ceb-4b5a-a2df-30f38a463f32"}]}} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:59:04.710963 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.network.neutron [None req-480da6cb-80c8-490a-b6d2-064d97fb8312 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] validate_networks() for [('c9d9f60a-7ceb-4b5a-a2df-30f38a463f32', None, None, None)] {{(pid=87932) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 13:59:05.590711 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-480da6cb-80c8-490a-b6d2-064d97fb8312 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Flavor limits 0:0:0 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 13:59:05.591679 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-480da6cb-80c8-490a-b6d2-064d97fb8312 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Image limits 0:0:0 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 13:59:05.592154 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-480da6cb-80c8-490a-b6d2-064d97fb8312 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Flavor pref 0:0:0 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 13:59:05.592626 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-480da6cb-80c8-490a-b6d2-064d97fb8312 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Image pref 0:0:0 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 13:59:05.593207 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.virt.hardware [None req-480da6cb-80c8-490a-b6d2-064d97fb8312 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 13:59:05.602619 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-480da6cb-80c8-490a-b6d2-064d97fb8312 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:59:05.603152 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-480da6cb-80c8-490a-b6d2-064d97fb8312 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:59:05.603993 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-480da6cb-80c8-490a-b6d2-064d97fb8312 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:59:05.604441 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-480da6cb-80c8-490a-b6d2-064d97fb8312 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:59:05.628703 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.quota [None req-480da6cb-80c8-490a-b6d2-064d97fb8312 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Getting quotas for project 84f3c43c33604ba0889f52e0fc038af6. Resources: {'ram', 'instances', 'cores'} {{(pid=87932) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 13:59:05.634196 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.quota [None req-480da6cb-80c8-490a-b6d2-064d97fb8312 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Getting quotas for user 29ea9144206a468fab90e65113903df0 and project 84f3c43c33604ba0889f52e0fc038af6. Resources: {'ram', 'instances', 'cores'} {{(pid=87932) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 13:59:05.747213 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-480da6cb-80c8-490a-b6d2-064d97fb8312 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Going to run 1 instances... {{(pid=87932) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 13:59:05.749835 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-480da6cb-80c8-490a-b6d2-064d97fb8312 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 338889a2-1e31-4d64-87ef-ce9f18f4477c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='677e7cef-4e86-41c1-be5b-c9fe288133b4',volume_size=None,volume_type=None)] {{(pid=87932) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 13:59:05.981450 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-480da6cb-80c8-490a-b6d2-064d97fb8312 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.456742 Apr 30 13:59:05.982777 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 906/1921] 10.222.0.79 () {60 vars in 1147 bytes} [Fri Apr 30 13:59:04 2021] POST /compute/v2.1/servers => generated 406 bytes in 1459 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 30 13:59:05.997502 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-7fd9c514-c0b8-40cc-8598-5f5cfe43ddb4 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:59:05.998363 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-7fd9c514-c0b8-40cc-8598-5f5cfe43ddb4 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 338889a2-1e31-4d64-87ef-ce9f18f4477c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:59:06.116933 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-7fd9c514-c0b8-40cc-8598-5f5cfe43ddb4 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:59:06.132572 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-7fd9c514-c0b8-40cc-8598-5f5cfe43ddb4 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/338889a2-1e31-4d64-87ef-ce9f18f4477c" status: 200 len: 1095 microversion: 2.1 time: 0.139476 Apr 30 13:59:06.133440 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 1016/1922] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:59:05 2021] GET /compute/v2.1/servers/338889a2-1e31-4d64-87ef-ce9f18f4477c => generated 1095 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:59:07.153586 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-c7b8a904-436b-4816-8e9e-45ec05eb8a84 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:59:07.154505 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-c7b8a904-436b-4816-8e9e-45ec05eb8a84 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 338889a2-1e31-4d64-87ef-ce9f18f4477c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:59:07.169293 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c7b8a904-436b-4816-8e9e-45ec05eb8a84 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:59:07.169844 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c7b8a904-436b-4816-8e9e-45ec05eb8a84 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:59:07.171743 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c7b8a904-436b-4816-8e9e-45ec05eb8a84 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:59:07.172316 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-c7b8a904-436b-4816-8e9e-45ec05eb8a84 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:59:07.352318 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-c7b8a904-436b-4816-8e9e-45ec05eb8a84 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:59:07.366559 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-c7b8a904-436b-4816-8e9e-45ec05eb8a84 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/338889a2-1e31-4d64-87ef-ce9f18f4477c" status: 200 len: 1193 microversion: 2.1 time: 0.217665 Apr 30 13:59:07.367151 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 907/1923] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:59:07 2021] GET /compute/v2.1/servers/338889a2-1e31-4d64-87ef-ce9f18f4477c => generated 1193 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:59:08.394726 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-206420a8-c36c-47e3-984b-cbf6afa3cb67 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:59:08.395916 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-206420a8-c36c-47e3-984b-cbf6afa3cb67 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 338889a2-1e31-4d64-87ef-ce9f18f4477c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:59:08.410595 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-206420a8-c36c-47e3-984b-cbf6afa3cb67 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:59:08.411418 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-206420a8-c36c-47e3-984b-cbf6afa3cb67 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:59:08.412836 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-206420a8-c36c-47e3-984b-cbf6afa3cb67 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:59:08.413610 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-206420a8-c36c-47e3-984b-cbf6afa3cb67 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:59:08.634876 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-206420a8-c36c-47e3-984b-cbf6afa3cb67 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:59:08.657110 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-206420a8-c36c-47e3-984b-cbf6afa3cb67 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/338889a2-1e31-4d64-87ef-ce9f18f4477c" status: 200 len: 1211 microversion: 2.1 time: 0.269019 Apr 30 13:59:08.657608 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 1017/1924] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:59:08 2021] GET /compute/v2.1/servers/338889a2-1e31-4d64-87ef-ce9f18f4477c => generated 1211 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:59:09.687261 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-6967a002-f397-45b5-bdb4-6e662f892c55 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:59:09.688456 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-6967a002-f397-45b5-bdb4-6e662f892c55 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 338889a2-1e31-4d64-87ef-ce9f18f4477c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:59:09.703074 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6967a002-f397-45b5-bdb4-6e662f892c55 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:59:09.703875 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6967a002-f397-45b5-bdb4-6e662f892c55 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:59:09.705326 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6967a002-f397-45b5-bdb4-6e662f892c55 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:59:09.706141 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-6967a002-f397-45b5-bdb4-6e662f892c55 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:59:10.514683 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-6967a002-f397-45b5-bdb4-6e662f892c55 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:59:10.532531 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-6967a002-f397-45b5-bdb4-6e662f892c55 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/338889a2-1e31-4d64-87ef-ce9f18f4477c" status: 200 len: 1267 microversion: 2.1 time: 0.852866 Apr 30 13:59:10.534266 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 908/1925] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:59:09 2021] GET /compute/v2.1/servers/338889a2-1e31-4d64-87ef-ce9f18f4477c => generated 1267 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:59:11.301946 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [req-e0ba2c7c-6171-4839-88cf-03548abf1cd7 req-61359a31-6e36-440e-95e2-2ed8e80c0757 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "338889a2-1e31-4d64-87ef-ce9f18f4477c", "tag": "bf10cbb8-6966-41e6-9df6-4d9e07d37624"}]} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:59:11.307628 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:59:11.307628 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: warnings.warn(msg) Apr 30 13:59:11.331216 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-e0ba2c7c-6171-4839-88cf-03548abf1cd7 req-61359a31-6e36-440e-95e2-2ed8e80c0757 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:59:11.333167 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-e0ba2c7c-6171-4839-88cf-03548abf1cd7 req-61359a31-6e36-440e-95e2-2ed8e80c0757 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:59:11.365693 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.compute.server_external_events [req-e0ba2c7c-6171-4839-88cf-03548abf1cd7 req-61359a31-6e36-440e-95e2-2ed8e80c0757 service nova] Creating event network-changed:bf10cbb8-6966-41e6-9df6-4d9e07d37624 for instance 338889a2-1e31-4d64-87ef-ce9f18f4477c on hv-cinder-78836 Apr 30 13:59:11.375746 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [req-e0ba2c7c-6171-4839-88cf-03548abf1cd7 req-61359a31-6e36-440e-95e2-2ed8e80c0757 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.213265 Apr 30 13:59:11.381161 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 1018/1926] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:59:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:59:11.568972 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-53b8eb39-1f80-4b12-8988-8e480a2ef453 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:59:11.569827 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-53b8eb39-1f80-4b12-8988-8e480a2ef453 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 338889a2-1e31-4d64-87ef-ce9f18f4477c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:59:11.578907 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-53b8eb39-1f80-4b12-8988-8e480a2ef453 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:59:11.579798 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-53b8eb39-1f80-4b12-8988-8e480a2ef453 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:59:11.580590 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-53b8eb39-1f80-4b12-8988-8e480a2ef453 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:59:11.581156 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-53b8eb39-1f80-4b12-8988-8e480a2ef453 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:59:12.066337 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-53b8eb39-1f80-4b12-8988-8e480a2ef453 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:59:12.080991 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-53b8eb39-1f80-4b12-8988-8e480a2ef453 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/338889a2-1e31-4d64-87ef-ce9f18f4477c" status: 200 len: 1267 microversion: 2.1 time: 0.519234 Apr 30 13:59:12.081928 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 909/1927] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:59:11 2021] GET /compute/v2.1/servers/338889a2-1e31-4d64-87ef-ce9f18f4477c => generated 1267 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:59:13.113197 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-41b6f1a4-e90d-417d-a1c7-1f6b36e49570 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:59:13.114615 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-41b6f1a4-e90d-417d-a1c7-1f6b36e49570 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 338889a2-1e31-4d64-87ef-ce9f18f4477c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:59:13.130648 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-41b6f1a4-e90d-417d-a1c7-1f6b36e49570 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:59:13.131363 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-41b6f1a4-e90d-417d-a1c7-1f6b36e49570 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:59:13.133710 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-41b6f1a4-e90d-417d-a1c7-1f6b36e49570 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:59:13.134624 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-41b6f1a4-e90d-417d-a1c7-1f6b36e49570 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:59:13.513682 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-41b6f1a4-e90d-417d-a1c7-1f6b36e49570 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:59:13.533694 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-41b6f1a4-e90d-417d-a1c7-1f6b36e49570 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/338889a2-1e31-4d64-87ef-ce9f18f4477c" status: 200 len: 1267 microversion: 2.1 time: 0.430972 Apr 30 13:59:13.535052 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 1019/1928] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:59:13 2021] GET /compute/v2.1/servers/338889a2-1e31-4d64-87ef-ce9f18f4477c => generated 1267 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:59:14.565657 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-b889a65b-c708-4e9c-be29-5525ec01059b tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:59:14.566494 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-b889a65b-c708-4e9c-be29-5525ec01059b tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 338889a2-1e31-4d64-87ef-ce9f18f4477c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:59:14.583212 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b889a65b-c708-4e9c-be29-5525ec01059b tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:59:14.584021 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b889a65b-c708-4e9c-be29-5525ec01059b tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:59:14.585471 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b889a65b-c708-4e9c-be29-5525ec01059b tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:59:14.586577 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b889a65b-c708-4e9c-be29-5525ec01059b tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:59:14.958463 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-b889a65b-c708-4e9c-be29-5525ec01059b tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:59:14.974755 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-b889a65b-c708-4e9c-be29-5525ec01059b tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/338889a2-1e31-4d64-87ef-ce9f18f4477c" status: 200 len: 1267 microversion: 2.1 time: 0.414688 Apr 30 13:59:14.975058 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 910/1929] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:59:14 2021] GET /compute/v2.1/servers/338889a2-1e31-4d64-87ef-ce9f18f4477c => generated 1267 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:59:16.000966 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-45271ada-63b8-41de-ae65-a8316e5aba71 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:59:16.002052 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-45271ada-63b8-41de-ae65-a8316e5aba71 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 338889a2-1e31-4d64-87ef-ce9f18f4477c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:59:16.017323 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-45271ada-63b8-41de-ae65-a8316e5aba71 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:59:16.018224 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-45271ada-63b8-41de-ae65-a8316e5aba71 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:59:16.019783 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-45271ada-63b8-41de-ae65-a8316e5aba71 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:59:16.020869 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-45271ada-63b8-41de-ae65-a8316e5aba71 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:59:16.383824 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-45271ada-63b8-41de-ae65-a8316e5aba71 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:59:16.393135 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-45271ada-63b8-41de-ae65-a8316e5aba71 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/338889a2-1e31-4d64-87ef-ce9f18f4477c" status: 200 len: 1267 microversion: 2.1 time: 0.399334 Apr 30 13:59:16.394148 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 1020/1930] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:59:15 2021] GET /compute/v2.1/servers/338889a2-1e31-4d64-87ef-ce9f18f4477c => generated 1267 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:59:17.422189 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-890d01c1-002b-477d-b017-6c7dc5999297 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:59:17.423323 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-890d01c1-002b-477d-b017-6c7dc5999297 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 338889a2-1e31-4d64-87ef-ce9f18f4477c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:59:17.439704 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-890d01c1-002b-477d-b017-6c7dc5999297 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:59:17.440503 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-890d01c1-002b-477d-b017-6c7dc5999297 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:59:17.441925 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-890d01c1-002b-477d-b017-6c7dc5999297 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:59:17.442987 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-890d01c1-002b-477d-b017-6c7dc5999297 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:59:17.816924 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-890d01c1-002b-477d-b017-6c7dc5999297 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:59:17.834239 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-890d01c1-002b-477d-b017-6c7dc5999297 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/338889a2-1e31-4d64-87ef-ce9f18f4477c" status: 200 len: 1267 microversion: 2.1 time: 0.419717 Apr 30 13:59:17.835254 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 911/1931] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:59:17 2021] GET /compute/v2.1/servers/338889a2-1e31-4d64-87ef-ce9f18f4477c => generated 1267 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:59:18.868186 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-397d35df-511b-4808-ab6a-a8df57b938be tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:59:18.869416 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-397d35df-511b-4808-ab6a-a8df57b938be tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 338889a2-1e31-4d64-87ef-ce9f18f4477c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:59:18.884566 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-397d35df-511b-4808-ab6a-a8df57b938be tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:59:18.885514 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-397d35df-511b-4808-ab6a-a8df57b938be tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:59:18.887329 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-397d35df-511b-4808-ab6a-a8df57b938be tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:59:18.888216 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-397d35df-511b-4808-ab6a-a8df57b938be tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:59:19.292878 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-397d35df-511b-4808-ab6a-a8df57b938be tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:59:19.311098 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-397d35df-511b-4808-ab6a-a8df57b938be tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/338889a2-1e31-4d64-87ef-ce9f18f4477c" status: 200 len: 1267 microversion: 2.1 time: 0.451095 Apr 30 13:59:19.312363 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 1021/1932] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:59:18 2021] GET /compute/v2.1/servers/338889a2-1e31-4d64-87ef-ce9f18f4477c => generated 1267 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:59:20.344682 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-f95c4f95-13b6-41aa-8d73-86463354d0a9 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:59:20.345876 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-f95c4f95-13b6-41aa-8d73-86463354d0a9 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 338889a2-1e31-4d64-87ef-ce9f18f4477c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:59:20.361487 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f95c4f95-13b6-41aa-8d73-86463354d0a9 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:59:20.362255 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f95c4f95-13b6-41aa-8d73-86463354d0a9 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:59:20.363596 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f95c4f95-13b6-41aa-8d73-86463354d0a9 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:59:20.364473 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f95c4f95-13b6-41aa-8d73-86463354d0a9 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:59:20.768474 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-f95c4f95-13b6-41aa-8d73-86463354d0a9 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:59:20.786167 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-f95c4f95-13b6-41aa-8d73-86463354d0a9 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/338889a2-1e31-4d64-87ef-ce9f18f4477c" status: 200 len: 1267 microversion: 2.1 time: 0.449565 Apr 30 13:59:20.787390 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 912/1933] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:59:20 2021] GET /compute/v2.1/servers/338889a2-1e31-4d64-87ef-ce9f18f4477c => generated 1267 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:59:21.820151 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-a1dd225e-2fe8-489b-9773-0f7ab170e648 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:59:21.821155 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-a1dd225e-2fe8-489b-9773-0f7ab170e648 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 338889a2-1e31-4d64-87ef-ce9f18f4477c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:59:21.835472 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a1dd225e-2fe8-489b-9773-0f7ab170e648 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:59:21.836296 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a1dd225e-2fe8-489b-9773-0f7ab170e648 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:59:21.837763 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a1dd225e-2fe8-489b-9773-0f7ab170e648 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:59:21.838587 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-a1dd225e-2fe8-489b-9773-0f7ab170e648 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:59:22.207859 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-a1dd225e-2fe8-489b-9773-0f7ab170e648 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:59:22.221576 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-a1dd225e-2fe8-489b-9773-0f7ab170e648 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/338889a2-1e31-4d64-87ef-ce9f18f4477c" status: 200 len: 1267 microversion: 2.1 time: 0.408665 Apr 30 13:59:22.222501 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 1022/1934] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:59:21 2021] GET /compute/v2.1/servers/338889a2-1e31-4d64-87ef-ce9f18f4477c => generated 1267 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:59:22.811464 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [req-8336e2ea-9c68-4b31-80d4-bda78ced2369 req-4314b4b2-b8d1-459c-a336-c2996df5543c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "338889a2-1e31-4d64-87ef-ce9f18f4477c", "name": "network-vif-plugged", "status": "completed", "tag": "bf10cbb8-6966-41e6-9df6-4d9e07d37624"}]} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:59:22.814150 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:59:22.814150 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: warnings.warn(msg) Apr 30 13:59:22.833251 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-8336e2ea-9c68-4b31-80d4-bda78ced2369 req-4314b4b2-b8d1-459c-a336-c2996df5543c service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:59:22.834079 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-8336e2ea-9c68-4b31-80d4-bda78ced2369 req-4314b4b2-b8d1-459c-a336-c2996df5543c service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:59:22.872590 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.compute.server_external_events [req-8336e2ea-9c68-4b31-80d4-bda78ced2369 req-4314b4b2-b8d1-459c-a336-c2996df5543c service nova] Creating event network-vif-plugged:bf10cbb8-6966-41e6-9df6-4d9e07d37624 for instance 338889a2-1e31-4d64-87ef-ce9f18f4477c on hv-cinder-78836 Apr 30 13:59:22.881909 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [req-8336e2ea-9c68-4b31-80d4-bda78ced2369 req-4314b4b2-b8d1-459c-a336-c2996df5543c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151674 Apr 30 13:59:22.883295 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 913/1935] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:59:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 13:59:23.245013 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-635e7ac7-44b3-4747-a613-a86fd887695b tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:59:23.247184 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-635e7ac7-44b3-4747-a613-a86fd887695b tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 338889a2-1e31-4d64-87ef-ce9f18f4477c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:59:23.262914 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-635e7ac7-44b3-4747-a613-a86fd887695b tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:59:23.263749 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-635e7ac7-44b3-4747-a613-a86fd887695b tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:59:23.264840 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-635e7ac7-44b3-4747-a613-a86fd887695b tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:59:23.265653 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-635e7ac7-44b3-4747-a613-a86fd887695b tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:59:23.595573 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-635e7ac7-44b3-4747-a613-a86fd887695b tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:59:23.612191 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-635e7ac7-44b3-4747-a613-a86fd887695b tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/338889a2-1e31-4d64-87ef-ce9f18f4477c" status: 200 len: 1267 microversion: 2.1 time: 0.371345 Apr 30 13:59:23.613233 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 1023/1936] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:59:23 2021] GET /compute/v2.1/servers/338889a2-1e31-4d64-87ef-ce9f18f4477c => generated 1267 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:59:24.638657 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-10639f2f-84f8-4561-9a8d-a76480ded4f6 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:59:24.639551 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-10639f2f-84f8-4561-9a8d-a76480ded4f6 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 338889a2-1e31-4d64-87ef-ce9f18f4477c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:59:24.649827 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-10639f2f-84f8-4561-9a8d-a76480ded4f6 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:59:24.650364 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-10639f2f-84f8-4561-9a8d-a76480ded4f6 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:59:24.651370 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-10639f2f-84f8-4561-9a8d-a76480ded4f6 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:59:24.652085 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-10639f2f-84f8-4561-9a8d-a76480ded4f6 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:59:24.971419 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-10639f2f-84f8-4561-9a8d-a76480ded4f6 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:59:24.984778 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-10639f2f-84f8-4561-9a8d-a76480ded4f6 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/338889a2-1e31-4d64-87ef-ce9f18f4477c" status: 200 len: 1455 microversion: 2.1 time: 0.350198 Apr 30 13:59:24.985820 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 914/1937] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:59:24 2021] GET /compute/v2.1/servers/338889a2-1e31-4d64-87ef-ce9f18f4477c => generated 1455 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 13:59:25.014735 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-13423ab0-a05e-4eee-883d-d972db65d093 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 13:59:25.015948 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-13423ab0-a05e-4eee-883d-d972db65d093 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 338889a2-1e31-4d64-87ef-ce9f18f4477c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 13:59:25.030827 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-13423ab0-a05e-4eee-883d-d972db65d093 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:59:25.031632 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-13423ab0-a05e-4eee-883d-d972db65d093 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:59:25.033033 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-13423ab0-a05e-4eee-883d-d972db65d093 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:59:25.033844 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-13423ab0-a05e-4eee-883d-d972db65d093 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:59:25.413306 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-13423ab0-a05e-4eee-883d-d972db65d093 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 13:59:25.430801 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-13423ab0-a05e-4eee-883d-d972db65d093 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/338889a2-1e31-4d64-87ef-ce9f18f4477c" status: 200 len: 1455 microversion: 2.1 time: 0.422775 Apr 30 13:59:25.432642 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 1024/1938] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 13:59:25 2021] GET /compute/v2.1/servers/338889a2-1e31-4d64-87ef-ce9f18f4477c => generated 1455 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 13:59:29.626422 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [req-aa5a7107-c81e-49c0-a884-27d6792b6b6c req-787faf8d-1e95-4353-aa00-ea0d12fd8627 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "338889a2-1e31-4d64-87ef-ce9f18f4477c", "tag": "bf10cbb8-6966-41e6-9df6-4d9e07d37624"}]} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 13:59:29.628146 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 13:59:29.628146 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: warnings.warn(msg) Apr 30 13:59:29.641115 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-aa5a7107-c81e-49c0-a884-27d6792b6b6c req-787faf8d-1e95-4353-aa00-ea0d12fd8627 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 13:59:29.641560 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-aa5a7107-c81e-49c0-a884-27d6792b6b6c req-787faf8d-1e95-4353-aa00-ea0d12fd8627 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 13:59:29.663784 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.compute.server_external_events [req-aa5a7107-c81e-49c0-a884-27d6792b6b6c req-787faf8d-1e95-4353-aa00-ea0d12fd8627 service nova] Creating event network-changed:bf10cbb8-6966-41e6-9df6-4d9e07d37624 for instance 338889a2-1e31-4d64-87ef-ce9f18f4477c on hv-cinder-78836 Apr 30 13:59:29.670545 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [req-aa5a7107-c81e-49c0-a884-27d6792b6b6c req-787faf8d-1e95-4353-aa00-ea0d12fd8627 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049860 Apr 30 13:59:29.671647 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 915/1939] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 13:59:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 14:00:02.849261 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 14:00:02.849985 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: Fri Apr 30 14:00:02 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 14:01:03.486820 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-5bf3c079-0d5c-4129-a83c-2525e109f0b6 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-974135593", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1132199581", "security_groups": [{"name": "tempest-secgroup-smoke-1144511476"}], "block_device_mapping_v2": [{"uuid": "8d390206-ffc3-4dc7-a682-b8906c445605", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c9d9f60a-7ceb-4b5a-a2df-30f38a463f32"}]}} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 14:01:03.499528 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fb5a7899-1fdb-42b6-bec0-d69e54b8f5a6] AMQP server on 10.222.0.79:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 30 14:01:03.658852 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.network.neutron [None req-5bf3c079-0d5c-4129-a83c-2525e109f0b6 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] validate_networks() for [('c9d9f60a-7ceb-4b5a-a2df-30f38a463f32', None, None, None)] {{(pid=87933) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Apr 30 14:01:04.465013 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.virt.hardware [None req-5bf3c079-0d5c-4129-a83c-2525e109f0b6 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Flavor limits 0:0:0 {{(pid=87933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:344}} Apr 30 14:01:04.465762 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.virt.hardware [None req-5bf3c079-0d5c-4129-a83c-2525e109f0b6 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Image limits 0:0:0 {{(pid=87933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Apr 30 14:01:04.466506 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.virt.hardware [None req-5bf3c079-0d5c-4129-a83c-2525e109f0b6 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Flavor pref 0:0:0 {{(pid=87933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:384}} Apr 30 14:01:04.466941 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.virt.hardware [None req-5bf3c079-0d5c-4129-a83c-2525e109f0b6 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Image pref 0:0:0 {{(pid=87933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Apr 30 14:01:04.467374 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.virt.hardware [None req-5bf3c079-0d5c-4129-a83c-2525e109f0b6 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=87933) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:426}} Apr 30 14:01:04.478197 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5bf3c079-0d5c-4129-a83c-2525e109f0b6 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:01:04.478645 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5bf3c079-0d5c-4129-a83c-2525e109f0b6 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:01:04.479456 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5bf3c079-0d5c-4129-a83c-2525e109f0b6 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:01:04.479896 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5bf3c079-0d5c-4129-a83c-2525e109f0b6 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:01:04.500075 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.quota [None req-5bf3c079-0d5c-4129-a83c-2525e109f0b6 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Getting quotas for project 84f3c43c33604ba0889f52e0fc038af6. Resources: {'ram', 'instances', 'cores'} {{(pid=87933) _get_quotas /opt/stack/nova/nova/quota.py:387}} Apr 30 14:01:04.517354 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.quota [None req-5bf3c079-0d5c-4129-a83c-2525e109f0b6 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Getting quotas for user 29ea9144206a468fab90e65113903df0 and project 84f3c43c33604ba0889f52e0fc038af6. Resources: {'ram', 'instances', 'cores'} {{(pid=87933) _get_quotas /opt/stack/nova/nova/quota.py:377}} Apr 30 14:01:04.529699 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO oslo.messaging._drivers.impl_rabbit [-] [fb5a7899-1fdb-42b6-bec0-d69e54b8f5a6] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 44902. Apr 30 14:01:04.648209 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-5bf3c079-0d5c-4129-a83c-2525e109f0b6 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Going to run 1 instances... {{(pid=87933) _provision_instances /opt/stack/nova/nova/compute/api.py:1283}} Apr 30 14:01:04.650385 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-5bf3c079-0d5c-4129-a83c-2525e109f0b6 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 4404f11f-8c7c-467a-9a39-7e39a2e63d58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8d390206-ffc3-4dc7-a682-b8906c445605',volume_size=None,volume_type=None)] {{(pid=87933) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1684}} Apr 30 14:01:04.873937 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-5bf3c079-0d5c-4129-a83c-2525e109f0b6 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.390441 Apr 30 14:01:04.880697 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 1025/1940] 10.222.0.79 () {60 vars in 1147 bytes} [Fri Apr 30 14:01:03 2021] POST /compute/v2.1/servers => generated 406 bytes in 1393 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 30 14:01:04.885375 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1abdcfbc-0fea-4857-8557-cdc275d2ef0c] AMQP server on 10.222.0.79:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Apr 30 14:01:04.892526 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-541cf071-893a-4c59-9810-164f05b5f6a5 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 14:01:04.893678 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-541cf071-893a-4c59-9810-164f05b5f6a5 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 4404f11f-8c7c-467a-9a39-7e39a2e63d58] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 14:01:04.983708 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-541cf071-893a-4c59-9810-164f05b5f6a5 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 14:01:04.997409 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-541cf071-893a-4c59-9810-164f05b5f6a5 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/4404f11f-8c7c-467a-9a39-7e39a2e63d58" status: 200 len: 1094 microversion: 2.1 time: 0.113842 Apr 30 14:01:04.998410 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 916/1941] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 14:01:04 2021] GET /compute/v2.1/servers/4404f11f-8c7c-467a-9a39-7e39a2e63d58 => generated 1094 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 14:01:06.018323 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-0cb7551d-bda5-4a7c-adc5-729e57d41363 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 14:01:06.019008 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-0cb7551d-bda5-4a7c-adc5-729e57d41363 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 4404f11f-8c7c-467a-9a39-7e39a2e63d58] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 14:01:06.099263 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-0cb7551d-bda5-4a7c-adc5-729e57d41363 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 14:01:06.107137 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-0cb7551d-bda5-4a7c-adc5-729e57d41363 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/4404f11f-8c7c-467a-9a39-7e39a2e63d58" status: 200 len: 1094 microversion: 2.1 time: 0.092529 Apr 30 14:01:06.107715 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 1026/1942] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 14:01:06 2021] GET /compute/v2.1/servers/4404f11f-8c7c-467a-9a39-7e39a2e63d58 => generated 1094 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 14:01:07.125695 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-53dfdf6a-1cfd-4a5f-ae40-47b8fc135017 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 14:01:07.126348 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-53dfdf6a-1cfd-4a5f-ae40-47b8fc135017 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 4404f11f-8c7c-467a-9a39-7e39a2e63d58] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 14:01:07.165839 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO oslo.messaging._drivers.impl_rabbit [-] [1abdcfbc-0fea-4857-8557-cdc275d2ef0c] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 44926. Apr 30 14:01:07.310509 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-53dfdf6a-1cfd-4a5f-ae40-47b8fc135017 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 14:01:07.319200 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-53dfdf6a-1cfd-4a5f-ae40-47b8fc135017 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/4404f11f-8c7c-467a-9a39-7e39a2e63d58" status: 200 len: 1094 microversion: 2.1 time: 0.197360 Apr 30 14:01:07.319765 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 917/1943] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 14:01:07 2021] GET /compute/v2.1/servers/4404f11f-8c7c-467a-9a39-7e39a2e63d58 => generated 1094 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 14:01:08.336704 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-bcada59f-c97f-4495-a121-9a0013288b14 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 14:01:08.337333 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-bcada59f-c97f-4495-a121-9a0013288b14 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 4404f11f-8c7c-467a-9a39-7e39a2e63d58] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 14:01:08.348997 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-bcada59f-c97f-4495-a121-9a0013288b14 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:01:08.349852 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-bcada59f-c97f-4495-a121-9a0013288b14 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:01:08.351273 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-bcada59f-c97f-4495-a121-9a0013288b14 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:01:08.351965 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-bcada59f-c97f-4495-a121-9a0013288b14 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:01:08.486133 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-bcada59f-c97f-4495-a121-9a0013288b14 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 14:01:08.495449 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-bcada59f-c97f-4495-a121-9a0013288b14 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/4404f11f-8c7c-467a-9a39-7e39a2e63d58" status: 200 len: 1144 microversion: 2.1 time: 0.163074 Apr 30 14:01:08.496095 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 1027/1944] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 14:01:08 2021] GET /compute/v2.1/servers/4404f11f-8c7c-467a-9a39-7e39a2e63d58 => generated 1144 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 14:01:09.512914 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-ec1755ef-2b67-4a0e-8389-b24ec2ecb84e tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 14:01:09.513537 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-ec1755ef-2b67-4a0e-8389-b24ec2ecb84e tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 4404f11f-8c7c-467a-9a39-7e39a2e63d58] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 14:01:09.523256 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ec1755ef-2b67-4a0e-8389-b24ec2ecb84e tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:01:09.523712 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ec1755ef-2b67-4a0e-8389-b24ec2ecb84e tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:01:09.524517 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ec1755ef-2b67-4a0e-8389-b24ec2ecb84e tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:01:09.524958 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ec1755ef-2b67-4a0e-8389-b24ec2ecb84e tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:01:09.655200 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-ec1755ef-2b67-4a0e-8389-b24ec2ecb84e tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 14:01:09.668219 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-ec1755ef-2b67-4a0e-8389-b24ec2ecb84e tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/4404f11f-8c7c-467a-9a39-7e39a2e63d58" status: 200 len: 1136 microversion: 2.1 time: 0.158834 Apr 30 14:01:09.668852 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 918/1945] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 14:01:09 2021] GET /compute/v2.1/servers/4404f11f-8c7c-467a-9a39-7e39a2e63d58 => generated 1136 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 14:01:10.687028 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-81ada548-d130-401a-bdb7-883b1c93c586 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 14:01:10.687603 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-81ada548-d130-401a-bdb7-883b1c93c586 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 4404f11f-8c7c-467a-9a39-7e39a2e63d58] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 14:01:10.696508 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-81ada548-d130-401a-bdb7-883b1c93c586 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:01:10.697028 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-81ada548-d130-401a-bdb7-883b1c93c586 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:01:10.697924 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-81ada548-d130-401a-bdb7-883b1c93c586 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:01:10.698471 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-81ada548-d130-401a-bdb7-883b1c93c586 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:01:10.841561 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-81ada548-d130-401a-bdb7-883b1c93c586 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 14:01:10.853316 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-81ada548-d130-401a-bdb7-883b1c93c586 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/4404f11f-8c7c-467a-9a39-7e39a2e63d58" status: 200 len: 1210 microversion: 2.1 time: 0.170160 Apr 30 14:01:10.853989 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 1028/1946] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 14:01:10 2021] GET /compute/v2.1/servers/4404f11f-8c7c-467a-9a39-7e39a2e63d58 => generated 1210 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 14:01:11.883240 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-77f16298-aaa5-402e-9fd9-b0ab4273e64f tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 14:01:11.884113 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-77f16298-aaa5-402e-9fd9-b0ab4273e64f tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 4404f11f-8c7c-467a-9a39-7e39a2e63d58] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 14:01:11.894664 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-77f16298-aaa5-402e-9fd9-b0ab4273e64f tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:01:11.895718 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-77f16298-aaa5-402e-9fd9-b0ab4273e64f tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:01:11.896734 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-77f16298-aaa5-402e-9fd9-b0ab4273e64f tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:01:11.897516 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-77f16298-aaa5-402e-9fd9-b0ab4273e64f tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:01:12.419493 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-77f16298-aaa5-402e-9fd9-b0ab4273e64f tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 14:01:12.430361 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-77f16298-aaa5-402e-9fd9-b0ab4273e64f tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/4404f11f-8c7c-467a-9a39-7e39a2e63d58" status: 200 len: 1266 microversion: 2.1 time: 0.559815 Apr 30 14:01:12.430845 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 919/1947] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 14:01:11 2021] GET /compute/v2.1/servers/4404f11f-8c7c-467a-9a39-7e39a2e63d58 => generated 1266 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 14:01:12.500119 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [req-97161812-423e-4133-ab42-be434d455027 req-d6ea4783-29dd-4b25-9e30-ffd83aba9c08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4404f11f-8c7c-467a-9a39-7e39a2e63d58", "tag": "298d390d-efdf-4c77-874a-689729c0e087"}]} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 14:01:12.502806 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 14:01:12.502806 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: warnings.warn(msg) Apr 30 14:01:12.518379 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-97161812-423e-4133-ab42-be434d455027 req-d6ea4783-29dd-4b25-9e30-ffd83aba9c08 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:01:12.519022 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-97161812-423e-4133-ab42-be434d455027 req-d6ea4783-29dd-4b25-9e30-ffd83aba9c08 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:01:12.551806 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.compute.server_external_events [req-97161812-423e-4133-ab42-be434d455027 req-d6ea4783-29dd-4b25-9e30-ffd83aba9c08 service nova] Creating event network-changed:298d390d-efdf-4c77-874a-689729c0e087 for instance 4404f11f-8c7c-467a-9a39-7e39a2e63d58 on hv-cinder-78836 Apr 30 14:01:12.560837 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [req-97161812-423e-4133-ab42-be434d455027 req-d6ea4783-29dd-4b25-9e30-ffd83aba9c08 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066548 Apr 30 14:01:12.562314 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 1029/1948] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 14:01:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 14:01:13.450730 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-e4ab1002-cb87-4338-9aef-2f494b43eaaa tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 14:01:13.451867 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-e4ab1002-cb87-4338-9aef-2f494b43eaaa tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 4404f11f-8c7c-467a-9a39-7e39a2e63d58] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 14:01:13.466438 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e4ab1002-cb87-4338-9aef-2f494b43eaaa tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:01:13.467225 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e4ab1002-cb87-4338-9aef-2f494b43eaaa tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:01:13.468220 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e4ab1002-cb87-4338-9aef-2f494b43eaaa tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:01:13.468583 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e4ab1002-cb87-4338-9aef-2f494b43eaaa tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:01:13.908488 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-e4ab1002-cb87-4338-9aef-2f494b43eaaa tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 14:01:13.917897 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-e4ab1002-cb87-4338-9aef-2f494b43eaaa tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/4404f11f-8c7c-467a-9a39-7e39a2e63d58" status: 200 len: 1266 microversion: 2.1 time: 0.473953 Apr 30 14:01:13.918505 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 920/1949] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 14:01:13 2021] GET /compute/v2.1/servers/4404f11f-8c7c-467a-9a39-7e39a2e63d58 => generated 1266 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 14:01:14.936227 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-52c34c55-6d30-494a-a1b5-bc9d746f5a17 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 14:01:14.936965 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-52c34c55-6d30-494a-a1b5-bc9d746f5a17 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 4404f11f-8c7c-467a-9a39-7e39a2e63d58] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 14:01:14.948364 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-52c34c55-6d30-494a-a1b5-bc9d746f5a17 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:01:14.949101 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-52c34c55-6d30-494a-a1b5-bc9d746f5a17 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:01:14.950183 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-52c34c55-6d30-494a-a1b5-bc9d746f5a17 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:01:14.950675 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-52c34c55-6d30-494a-a1b5-bc9d746f5a17 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:01:15.207077 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-52c34c55-6d30-494a-a1b5-bc9d746f5a17 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 14:01:15.216903 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-52c34c55-6d30-494a-a1b5-bc9d746f5a17 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/4404f11f-8c7c-467a-9a39-7e39a2e63d58" status: 200 len: 1266 microversion: 2.1 time: 0.285357 Apr 30 14:01:15.217619 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 1030/1950] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 14:01:14 2021] GET /compute/v2.1/servers/4404f11f-8c7c-467a-9a39-7e39a2e63d58 => generated 1266 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 14:01:16.238654 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-21ba5037-11b4-4536-97a0-3e5aa0eff82f tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 14:01:16.239760 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-21ba5037-11b4-4536-97a0-3e5aa0eff82f tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 4404f11f-8c7c-467a-9a39-7e39a2e63d58] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 14:01:16.248923 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-21ba5037-11b4-4536-97a0-3e5aa0eff82f tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:01:16.249691 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-21ba5037-11b4-4536-97a0-3e5aa0eff82f tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:01:16.251056 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-21ba5037-11b4-4536-97a0-3e5aa0eff82f tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:01:16.251806 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-21ba5037-11b4-4536-97a0-3e5aa0eff82f tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:01:16.564598 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-21ba5037-11b4-4536-97a0-3e5aa0eff82f tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 14:01:16.578171 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-21ba5037-11b4-4536-97a0-3e5aa0eff82f tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/4404f11f-8c7c-467a-9a39-7e39a2e63d58" status: 200 len: 1266 microversion: 2.1 time: 0.346259 Apr 30 14:01:16.579215 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 921/1951] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 14:01:16 2021] GET /compute/v2.1/servers/4404f11f-8c7c-467a-9a39-7e39a2e63d58 => generated 1266 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 14:01:17.604715 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-c27ad4cc-4bec-4fcf-91b7-42dcf0027561 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 14:01:17.605529 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-c27ad4cc-4bec-4fcf-91b7-42dcf0027561 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 4404f11f-8c7c-467a-9a39-7e39a2e63d58] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 14:01:17.613528 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c27ad4cc-4bec-4fcf-91b7-42dcf0027561 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:01:17.614233 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c27ad4cc-4bec-4fcf-91b7-42dcf0027561 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:01:17.615075 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c27ad4cc-4bec-4fcf-91b7-42dcf0027561 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:01:17.615561 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c27ad4cc-4bec-4fcf-91b7-42dcf0027561 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:01:17.908074 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-c27ad4cc-4bec-4fcf-91b7-42dcf0027561 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 14:01:17.918894 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-c27ad4cc-4bec-4fcf-91b7-42dcf0027561 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/4404f11f-8c7c-467a-9a39-7e39a2e63d58" status: 200 len: 1266 microversion: 2.1 time: 0.317992 Apr 30 14:01:17.919480 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 1031/1952] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 14:01:17 2021] GET /compute/v2.1/servers/4404f11f-8c7c-467a-9a39-7e39a2e63d58 => generated 1266 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 14:01:18.935247 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-27e560e6-a9b5-4a0f-b551-491c0f9d3d2e tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 14:01:18.935861 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-27e560e6-a9b5-4a0f-b551-491c0f9d3d2e tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 4404f11f-8c7c-467a-9a39-7e39a2e63d58] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 14:01:18.944199 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-27e560e6-a9b5-4a0f-b551-491c0f9d3d2e tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:01:18.944775 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-27e560e6-a9b5-4a0f-b551-491c0f9d3d2e tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:01:18.945665 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-27e560e6-a9b5-4a0f-b551-491c0f9d3d2e tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:01:18.946253 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-27e560e6-a9b5-4a0f-b551-491c0f9d3d2e tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:01:19.177025 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-27e560e6-a9b5-4a0f-b551-491c0f9d3d2e tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 14:01:19.185531 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-27e560e6-a9b5-4a0f-b551-491c0f9d3d2e tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/4404f11f-8c7c-467a-9a39-7e39a2e63d58" status: 200 len: 1266 microversion: 2.1 time: 0.253992 Apr 30 14:01:19.186121 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 922/1953] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 14:01:18 2021] GET /compute/v2.1/servers/4404f11f-8c7c-467a-9a39-7e39a2e63d58 => generated 1266 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 14:01:20.202834 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-873ba919-0b3a-43d6-94ce-075c1d8a25ed tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 14:01:20.203485 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-873ba919-0b3a-43d6-94ce-075c1d8a25ed tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 4404f11f-8c7c-467a-9a39-7e39a2e63d58] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 14:01:20.211925 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-873ba919-0b3a-43d6-94ce-075c1d8a25ed tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:01:20.212428 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-873ba919-0b3a-43d6-94ce-075c1d8a25ed tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:01:20.213326 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-873ba919-0b3a-43d6-94ce-075c1d8a25ed tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:01:20.214020 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-873ba919-0b3a-43d6-94ce-075c1d8a25ed tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:01:20.438508 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-873ba919-0b3a-43d6-94ce-075c1d8a25ed tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 14:01:20.453804 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-873ba919-0b3a-43d6-94ce-075c1d8a25ed tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/4404f11f-8c7c-467a-9a39-7e39a2e63d58" status: 200 len: 1266 microversion: 2.1 time: 0.254176 Apr 30 14:01:20.454754 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 1032/1954] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 14:01:20 2021] GET /compute/v2.1/servers/4404f11f-8c7c-467a-9a39-7e39a2e63d58 => generated 1266 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 14:01:21.538676 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-e8cfbe7a-6222-4bf4-81e6-c28335816711 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 14:01:21.539330 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-e8cfbe7a-6222-4bf4-81e6-c28335816711 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 4404f11f-8c7c-467a-9a39-7e39a2e63d58] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 14:01:21.547145 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e8cfbe7a-6222-4bf4-81e6-c28335816711 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:01:21.547596 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e8cfbe7a-6222-4bf4-81e6-c28335816711 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:01:21.548408 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e8cfbe7a-6222-4bf4-81e6-c28335816711 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:01:21.548854 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-e8cfbe7a-6222-4bf4-81e6-c28335816711 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:01:21.814622 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-e8cfbe7a-6222-4bf4-81e6-c28335816711 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 14:01:21.834579 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-e8cfbe7a-6222-4bf4-81e6-c28335816711 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/4404f11f-8c7c-467a-9a39-7e39a2e63d58" status: 200 len: 1266 microversion: 2.1 time: 0.358590 Apr 30 14:01:21.836359 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 923/1955] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 14:01:21 2021] GET /compute/v2.1/servers/4404f11f-8c7c-467a-9a39-7e39a2e63d58 => generated 1266 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 14:01:22.853127 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-2fc58884-c24a-4a83-b32f-d29ea6ea0233 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 14:01:22.853880 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-2fc58884-c24a-4a83-b32f-d29ea6ea0233 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 4404f11f-8c7c-467a-9a39-7e39a2e63d58] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 14:01:22.863088 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2fc58884-c24a-4a83-b32f-d29ea6ea0233 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:01:22.863661 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2fc58884-c24a-4a83-b32f-d29ea6ea0233 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:01:22.864479 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2fc58884-c24a-4a83-b32f-d29ea6ea0233 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:01:22.864938 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-2fc58884-c24a-4a83-b32f-d29ea6ea0233 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:01:23.110228 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-2fc58884-c24a-4a83-b32f-d29ea6ea0233 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 14:01:23.120670 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-2fc58884-c24a-4a83-b32f-d29ea6ea0233 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/4404f11f-8c7c-467a-9a39-7e39a2e63d58" status: 200 len: 1266 microversion: 2.1 time: 0.271205 Apr 30 14:01:23.121463 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 1033/1956] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 14:01:22 2021] GET /compute/v2.1/servers/4404f11f-8c7c-467a-9a39-7e39a2e63d58 => generated 1266 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 14:01:23.256622 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [req-c73df9e1-70cd-4459-a634-138e1c39d7b1 req-bf853b85-5954-485e-8c2f-06a5cf1c33be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4404f11f-8c7c-467a-9a39-7e39a2e63d58", "name": "network-vif-plugged", "status": "completed", "tag": "298d390d-efdf-4c77-874a-689729c0e087"}]} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 14:01:23.259060 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 14:01:23.259060 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: warnings.warn(msg) Apr 30 14:01:23.270545 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-c73df9e1-70cd-4459-a634-138e1c39d7b1 req-bf853b85-5954-485e-8c2f-06a5cf1c33be service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:01:23.271178 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-c73df9e1-70cd-4459-a634-138e1c39d7b1 req-bf853b85-5954-485e-8c2f-06a5cf1c33be service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:01:23.289524 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.compute.server_external_events [req-c73df9e1-70cd-4459-a634-138e1c39d7b1 req-bf853b85-5954-485e-8c2f-06a5cf1c33be service nova] Creating event network-vif-plugged:298d390d-efdf-4c77-874a-689729c0e087 for instance 4404f11f-8c7c-467a-9a39-7e39a2e63d58 on hv-cinder-78836 Apr 30 14:01:23.294852 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [req-c73df9e1-70cd-4459-a634-138e1c39d7b1 req-bf853b85-5954-485e-8c2f-06a5cf1c33be service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043976 Apr 30 14:01:23.295628 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 924/1957] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 14:01:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 30 14:01:24.137257 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-e95fbbf2-689b-4997-9001-baa0ff4e6743 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 14:01:24.138503 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-e95fbbf2-689b-4997-9001-baa0ff4e6743 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 4404f11f-8c7c-467a-9a39-7e39a2e63d58] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 14:01:24.145895 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e95fbbf2-689b-4997-9001-baa0ff4e6743 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:01:24.146388 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e95fbbf2-689b-4997-9001-baa0ff4e6743 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:01:24.147199 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e95fbbf2-689b-4997-9001-baa0ff4e6743 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:01:24.147647 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-e95fbbf2-689b-4997-9001-baa0ff4e6743 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:01:24.569632 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-e95fbbf2-689b-4997-9001-baa0ff4e6743 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 14:01:24.591407 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-e95fbbf2-689b-4997-9001-baa0ff4e6743 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/4404f11f-8c7c-467a-9a39-7e39a2e63d58" status: 200 len: 1266 microversion: 2.1 time: 0.457938 Apr 30 14:01:24.592861 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 1034/1958] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 14:01:24 2021] GET /compute/v2.1/servers/4404f11f-8c7c-467a-9a39-7e39a2e63d58 => generated 1266 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 14:01:25.612400 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-56f124bc-8c29-409a-a684-07ece832f820 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 14:01:25.613112 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-56f124bc-8c29-409a-a684-07ece832f820 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 4404f11f-8c7c-467a-9a39-7e39a2e63d58] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 14:01:25.621226 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-56f124bc-8c29-409a-a684-07ece832f820 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:01:25.621680 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-56f124bc-8c29-409a-a684-07ece832f820 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:01:25.622530 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-56f124bc-8c29-409a-a684-07ece832f820 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:01:25.622984 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-56f124bc-8c29-409a-a684-07ece832f820 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:01:25.866782 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-56f124bc-8c29-409a-a684-07ece832f820 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 14:01:25.882652 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-56f124bc-8c29-409a-a684-07ece832f820 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/4404f11f-8c7c-467a-9a39-7e39a2e63d58" status: 200 len: 1453 microversion: 2.1 time: 0.274020 Apr 30 14:01:25.883984 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 925/1959] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 14:01:25 2021] GET /compute/v2.1/servers/4404f11f-8c7c-467a-9a39-7e39a2e63d58 => generated 1453 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 30 14:01:25.902474 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-1cc6a39d-dc0e-4c74-a859-93411db4f254 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 14:01:25.903293 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-1cc6a39d-dc0e-4c74-a859-93411db4f254 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 4404f11f-8c7c-467a-9a39-7e39a2e63d58] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 14:01:25.911905 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1cc6a39d-dc0e-4c74-a859-93411db4f254 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:01:25.912379 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1cc6a39d-dc0e-4c74-a859-93411db4f254 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:01:25.913197 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1cc6a39d-dc0e-4c74-a859-93411db4f254 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:01:25.913925 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1cc6a39d-dc0e-4c74-a859-93411db4f254 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:01:26.150066 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-1cc6a39d-dc0e-4c74-a859-93411db4f254 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 14:01:26.158925 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-1cc6a39d-dc0e-4c74-a859-93411db4f254 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/4404f11f-8c7c-467a-9a39-7e39a2e63d58" status: 200 len: 1453 microversion: 2.1 time: 0.260678 Apr 30 14:01:26.160241 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 1035/1960] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 14:01:25 2021] GET /compute/v2.1/servers/4404f11f-8c7c-467a-9a39-7e39a2e63d58 => generated 1453 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 14:01:28.888084 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [req-b2cd993e-da28-4376-9817-bbed450721ed req-515f90e5-5ee5-4900-a7c6-cc01f30b3173 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4404f11f-8c7c-467a-9a39-7e39a2e63d58", "tag": "298d390d-efdf-4c77-874a-689729c0e087"}]} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 14:01:28.892563 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 14:01:28.892563 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: warnings.warn(msg) Apr 30 14:01:28.909203 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-b2cd993e-da28-4376-9817-bbed450721ed req-515f90e5-5ee5-4900-a7c6-cc01f30b3173 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:01:28.910359 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-b2cd993e-da28-4376-9817-bbed450721ed req-515f90e5-5ee5-4900-a7c6-cc01f30b3173 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:01:28.929684 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.compute.server_external_events [req-b2cd993e-da28-4376-9817-bbed450721ed req-515f90e5-5ee5-4900-a7c6-cc01f30b3173 service nova] Creating event network-changed:298d390d-efdf-4c77-874a-689729c0e087 for instance 4404f11f-8c7c-467a-9a39-7e39a2e63d58 on hv-cinder-78836 Apr 30 14:01:28.944741 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [req-b2cd993e-da28-4376-9817-bbed450721ed req-515f90e5-5ee5-4900-a7c6-cc01f30b3173 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151482 Apr 30 14:01:28.945629 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 926/1961] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 14:01:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 14:01:46.867588 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 14:01:46.868481 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: Fri Apr 30 14:01:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 14:02:02.638543 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 14:02:02.639164 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: Fri Apr 30 14:02:02 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 14:02:07.557892 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 14:02:07.558543 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: Fri Apr 30 14:02:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 14:02:57.745694 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-9c36e921-5cd6-4e8f-8c3b-99c24131e302 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 14:02:57.746773 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-9c36e921-5cd6-4e8f-8c3b-99c24131e302 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 4404f11f-8c7c-467a-9a39-7e39a2e63d58] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 14:02:57.755827 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [req-ea6ca16a-f1c9-4878-a0d6-403e407ffdf7 req-c8705ee5-4b27-4942-92b7-7a6a303c6463 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4404f11f-8c7c-467a-9a39-7e39a2e63d58", "tag": "298d390d-efdf-4c77-874a-689729c0e087"}]} {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 14:02:57.758239 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9c36e921-5cd6-4e8f-8c3b-99c24131e302 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:02:57.758710 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9c36e921-5cd6-4e8f-8c3b-99c24131e302 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:02:57.758826 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 14:02:57.758826 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: warnings.warn(msg) Apr 30 14:02:57.759518 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9c36e921-5cd6-4e8f-8c3b-99c24131e302 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:02:57.759967 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-9c36e921-5cd6-4e8f-8c3b-99c24131e302 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:02:57.776864 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-ea6ca16a-f1c9-4878-a0d6-403e407ffdf7 req-c8705ee5-4b27-4942-92b7-7a6a303c6463 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:02:57.777750 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [req-ea6ca16a-f1c9-4878-a0d6-403e407ffdf7 req-c8705ee5-4b27-4942-92b7-7a6a303c6463 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:02:57.810787 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.compute.server_external_events [req-ea6ca16a-f1c9-4878-a0d6-403e407ffdf7 req-c8705ee5-4b27-4942-92b7-7a6a303c6463 service nova] Creating event network-changed:298d390d-efdf-4c77-874a-689729c0e087 for instance 4404f11f-8c7c-467a-9a39-7e39a2e63d58 on hv-cinder-78836 Apr 30 14:02:57.818474 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [req-ea6ca16a-f1c9-4878-a0d6-403e407ffdf7 req-c8705ee5-4b27-4942-92b7-7a6a303c6463 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088194 Apr 30 14:02:57.819838 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 927/1962] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 14:02:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 14:02:57.835252 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-9c36e921-5cd6-4e8f-8c3b-99c24131e302 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 4404f11f-8c7c-467a-9a39-7e39a2e63d58] Going to try to terminate instance {{(pid=87933) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 14:02:57.966996 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-9c36e921-5cd6-4e8f-8c3b-99c24131e302 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "DELETE /compute/v2.1/servers/4404f11f-8c7c-467a-9a39-7e39a2e63d58" status: 204 len: 0 microversion: 2.1 time: 0.227153 Apr 30 14:02:57.968584 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 1036/1963] 10.222.0.79 () {58 vars in 1239 bytes} [Fri Apr 30 14:02:57 2021] DELETE /compute/v2.1/servers/4404f11f-8c7c-467a-9a39-7e39a2e63d58 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 14:02:57.985443 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-b8e356dd-47c6-4202-8d86-beb333afad22 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 14:02:57.986778 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-b8e356dd-47c6-4202-8d86-beb333afad22 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 4404f11f-8c7c-467a-9a39-7e39a2e63d58] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 14:02:58.001169 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b8e356dd-47c6-4202-8d86-beb333afad22 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:02:58.002079 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b8e356dd-47c6-4202-8d86-beb333afad22 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:02:58.003509 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b8e356dd-47c6-4202-8d86-beb333afad22 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:02:58.004342 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b8e356dd-47c6-4202-8d86-beb333afad22 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:02:58.295929 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-b8e356dd-47c6-4202-8d86-beb333afad22 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 14:02:58.309253 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-b8e356dd-47c6-4202-8d86-beb333afad22 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/4404f11f-8c7c-467a-9a39-7e39a2e63d58" status: 200 len: 1578 microversion: 2.1 time: 0.333670 Apr 30 14:02:58.310564 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 928/1964] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 14:02:57 2021] GET /compute/v2.1/servers/4404f11f-8c7c-467a-9a39-7e39a2e63d58 => generated 1578 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 14:02:59.337552 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-ec2642b7-1b89-4ac2-8974-23587a726e88 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 14:02:59.338459 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-ec2642b7-1b89-4ac2-8974-23587a726e88 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 4404f11f-8c7c-467a-9a39-7e39a2e63d58] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 14:02:59.348507 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ec2642b7-1b89-4ac2-8974-23587a726e88 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:02:59.349082 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ec2642b7-1b89-4ac2-8974-23587a726e88 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:02:59.350104 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ec2642b7-1b89-4ac2-8974-23587a726e88 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:02:59.350747 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-ec2642b7-1b89-4ac2-8974-23587a726e88 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:02:59.668101 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-ec2642b7-1b89-4ac2-8974-23587a726e88 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 14:02:59.680892 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-ec2642b7-1b89-4ac2-8974-23587a726e88 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/4404f11f-8c7c-467a-9a39-7e39a2e63d58" status: 200 len: 1459 microversion: 2.1 time: 0.348540 Apr 30 14:02:59.681732 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 1037/1965] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 14:02:59 2021] GET /compute/v2.1/servers/4404f11f-8c7c-467a-9a39-7e39a2e63d58 => generated 1459 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 14:03:00.703917 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-ac9e1a02-0b63-4426-ab1f-d3195fe5e516 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 14:03:00.704667 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-ac9e1a02-0b63-4426-ab1f-d3195fe5e516 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 4404f11f-8c7c-467a-9a39-7e39a2e63d58] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 14:03:00.715286 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ac9e1a02-0b63-4426-ab1f-d3195fe5e516 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:03:00.715845 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ac9e1a02-0b63-4426-ab1f-d3195fe5e516 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:03:00.716294 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [req-adde2673-04f0-4519-9bf8-4bf21cbb4775 req-da6c5dc0-1537-4bf9-9893-ee27053ee12a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4404f11f-8c7c-467a-9a39-7e39a2e63d58", "name": "network-vif-deleted", "tag": "298d390d-efdf-4c77-874a-689729c0e087"}]} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 14:03:00.716894 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ac9e1a02-0b63-4426-ab1f-d3195fe5e516 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:03:00.717107 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-ac9e1a02-0b63-4426-ab1f-d3195fe5e516 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:03:00.717896 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 14:03:00.717896 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: warnings.warn(msg) Apr 30 14:03:00.728452 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-adde2673-04f0-4519-9bf8-4bf21cbb4775 req-da6c5dc0-1537-4bf9-9893-ee27053ee12a service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:03:00.728901 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-adde2673-04f0-4519-9bf8-4bf21cbb4775 req-da6c5dc0-1537-4bf9-9893-ee27053ee12a service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:03:00.765159 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.compute.server_external_events [req-adde2673-04f0-4519-9bf8-4bf21cbb4775 req-da6c5dc0-1537-4bf9-9893-ee27053ee12a service nova] Creating event network-vif-deleted:298d390d-efdf-4c77-874a-689729c0e087 for instance 4404f11f-8c7c-467a-9a39-7e39a2e63d58 on hv-cinder-78836 Apr 30 14:03:00.772156 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [req-adde2673-04f0-4519-9bf8-4bf21cbb4775 req-da6c5dc0-1537-4bf9-9893-ee27053ee12a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059905 Apr 30 14:03:00.773003 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 1038/1966] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 14:03:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 14:03:00.862734 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-ac9e1a02-0b63-4426-ab1f-d3195fe5e516 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 14:03:00.871454 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-ac9e1a02-0b63-4426-ab1f-d3195fe5e516 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/4404f11f-8c7c-467a-9a39-7e39a2e63d58" status: 200 len: 1391 microversion: 2.1 time: 0.173355 Apr 30 14:03:00.872050 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 929/1967] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 14:03:00 2021] GET /compute/v2.1/servers/4404f11f-8c7c-467a-9a39-7e39a2e63d58 => generated 1391 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 14:03:01.893822 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-1b34dda8-7901-43eb-a8af-c1910e86542a tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 14:03:01.895294 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-1b34dda8-7901-43eb-a8af-c1910e86542a tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 4404f11f-8c7c-467a-9a39-7e39a2e63d58] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 14:03:01.904865 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1b34dda8-7901-43eb-a8af-c1910e86542a tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:03:01.905317 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1b34dda8-7901-43eb-a8af-c1910e86542a tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:03:01.906695 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1b34dda8-7901-43eb-a8af-c1910e86542a tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:03:01.907197 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-1b34dda8-7901-43eb-a8af-c1910e86542a tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:03:01.956919 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.wsgi [None req-1b34dda8-7901-43eb-a8af-c1910e86542a tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] HTTP exception thrown: Instance 4404f11f-8c7c-467a-9a39-7e39a2e63d58 could not be found. Apr 30 14:03:01.957519 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-1b34dda8-7901-43eb-a8af-c1910e86542a tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Returning 404 to user: Instance 4404f11f-8c7c-467a-9a39-7e39a2e63d58 could not be found. {{(pid=87933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 14:03:01.958382 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-1b34dda8-7901-43eb-a8af-c1910e86542a tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/4404f11f-8c7c-467a-9a39-7e39a2e63d58" status: 404 len: 111 microversion: 2.1 time: 0.072500 Apr 30 14:03:01.958939 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 1039/1968] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 14:03:01 2021] GET /compute/v2.1/servers/4404f11f-8c7c-467a-9a39-7e39a2e63d58 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 14:03:06.072563 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-a37e481d-3a6d-41a0-9753-0360edc9ba6c tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 14:03:06.073652 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-a37e481d-3a6d-41a0-9753-0360edc9ba6c tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 338889a2-1e31-4d64-87ef-ce9f18f4477c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 14:03:06.074818 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [req-695e1611-39e6-49dc-bb88-e525cbdc55f0 req-fc41a7c2-7b75-49d0-8a24-bec2d52033a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "338889a2-1e31-4d64-87ef-ce9f18f4477c", "tag": "bf10cbb8-6966-41e6-9df6-4d9e07d37624"}]} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 14:03:06.076498 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 14:03:06.076498 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: warnings.warn(msg) Apr 30 14:03:06.085927 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-695e1611-39e6-49dc-bb88-e525cbdc55f0 req-fc41a7c2-7b75-49d0-8a24-bec2d52033a3 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:03:06.086414 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-695e1611-39e6-49dc-bb88-e525cbdc55f0 req-fc41a7c2-7b75-49d0-8a24-bec2d52033a3 service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:03:06.086989 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a37e481d-3a6d-41a0-9753-0360edc9ba6c tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:03:06.087717 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a37e481d-3a6d-41a0-9753-0360edc9ba6c tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:03:06.089201 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a37e481d-3a6d-41a0-9753-0360edc9ba6c tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:03:06.089852 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-a37e481d-3a6d-41a0-9753-0360edc9ba6c tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:03:06.106057 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.compute.server_external_events [req-695e1611-39e6-49dc-bb88-e525cbdc55f0 req-fc41a7c2-7b75-49d0-8a24-bec2d52033a3 service nova] Creating event network-changed:bf10cbb8-6966-41e6-9df6-4d9e07d37624 for instance 338889a2-1e31-4d64-87ef-ce9f18f4477c on hv-cinder-78836 Apr 30 14:03:06.114180 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [req-695e1611-39e6-49dc-bb88-e525cbdc55f0 req-fc41a7c2-7b75-49d0-8a24-bec2d52033a3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043788 Apr 30 14:03:06.115326 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 1040/1969] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 14:03:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 14:03:06.233083 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-a37e481d-3a6d-41a0-9753-0360edc9ba6c tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 338889a2-1e31-4d64-87ef-ce9f18f4477c] Going to try to terminate instance {{(pid=87932) delete /opt/stack/nova/nova/compute/api.py:2564}} Apr 30 14:03:06.370448 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-a37e481d-3a6d-41a0-9753-0360edc9ba6c tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "DELETE /compute/v2.1/servers/338889a2-1e31-4d64-87ef-ce9f18f4477c" status: 204 len: 0 microversion: 2.1 time: 0.303446 Apr 30 14:03:06.371641 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 930/1970] 10.222.0.79 () {58 vars in 1239 bytes} [Fri Apr 30 14:03:06 2021] DELETE /compute/v2.1/servers/338889a2-1e31-4d64-87ef-ce9f18f4477c => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 30 14:03:06.380867 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-5cbbbc2e-1df1-40ab-a506-5fe7166a61c6 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 14:03:06.381586 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-5cbbbc2e-1df1-40ab-a506-5fe7166a61c6 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 338889a2-1e31-4d64-87ef-ce9f18f4477c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 14:03:06.389325 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5cbbbc2e-1df1-40ab-a506-5fe7166a61c6 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:03:06.389781 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5cbbbc2e-1df1-40ab-a506-5fe7166a61c6 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:03:06.391426 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5cbbbc2e-1df1-40ab-a506-5fe7166a61c6 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:03:06.391977 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-5cbbbc2e-1df1-40ab-a506-5fe7166a61c6 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:03:06.784698 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.policy [None req-5cbbbc2e-1df1-40ab-a506-5fe7166a61c6 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87933) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 14:03:06.802124 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-5cbbbc2e-1df1-40ab-a506-5fe7166a61c6 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/338889a2-1e31-4d64-87ef-ce9f18f4477c" status: 200 len: 1578 microversion: 2.1 time: 0.425330 Apr 30 14:03:06.806737 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 1041/1971] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 14:03:06 2021] GET /compute/v2.1/servers/338889a2-1e31-4d64-87ef-ce9f18f4477c => generated 1578 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 14:03:07.821086 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-b7d793c9-c23c-4ff1-8b39-e8611048d36a tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 14:03:07.821799 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-b7d793c9-c23c-4ff1-8b39-e8611048d36a tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 338889a2-1e31-4d64-87ef-ce9f18f4477c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 14:03:07.829840 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b7d793c9-c23c-4ff1-8b39-e8611048d36a tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:03:07.830327 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b7d793c9-c23c-4ff1-8b39-e8611048d36a tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:03:07.831120 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b7d793c9-c23c-4ff1-8b39-e8611048d36a tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:03:07.831565 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b7d793c9-c23c-4ff1-8b39-e8611048d36a tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:03:08.035784 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-b7d793c9-c23c-4ff1-8b39-e8611048d36a tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 14:03:08.045876 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-b7d793c9-c23c-4ff1-8b39-e8611048d36a tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/338889a2-1e31-4d64-87ef-ce9f18f4477c" status: 200 len: 1461 microversion: 2.1 time: 0.229011 Apr 30 14:03:08.046996 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 931/1972] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 14:03:07 2021] GET /compute/v2.1/servers/338889a2-1e31-4d64-87ef-ce9f18f4477c => generated 1461 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 14:03:08.935345 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [req-e90abbc9-fad4-4bd6-8742-578f44ad0bae req-2ba726e5-58e9-4ea0-a203-7dff6b44ac6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "338889a2-1e31-4d64-87ef-ce9f18f4477c", "name": "network-vif-deleted", "tag": "bf10cbb8-6966-41e6-9df6-4d9e07d37624"}]} {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 30 14:03:08.937062 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1054: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 30 14:03:08.937062 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: warnings.warn(msg) Apr 30 14:03:08.947077 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-e90abbc9-fad4-4bd6-8742-578f44ad0bae req-2ba726e5-58e9-4ea0-a203-7dff6b44ac6a service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:03:08.947582 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [req-e90abbc9-fad4-4bd6-8742-578f44ad0bae req-2ba726e5-58e9-4ea0-a203-7dff6b44ac6a service nova] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:03:08.966954 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.compute.server_external_events [req-e90abbc9-fad4-4bd6-8742-578f44ad0bae req-2ba726e5-58e9-4ea0-a203-7dff6b44ac6a service nova] Creating event network-vif-deleted:bf10cbb8-6966-41e6-9df6-4d9e07d37624 for instance 338889a2-1e31-4d64-87ef-ce9f18f4477c on hv-cinder-78836 Apr 30 14:03:08.973106 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [req-e90abbc9-fad4-4bd6-8742-578f44ad0bae req-2ba726e5-58e9-4ea0-a203-7dff6b44ac6a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041578 Apr 30 14:03:08.973721 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 1042/1973] 10.222.0.79 () {64 vars in 1318 bytes} [Fri Apr 30 14:03:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 30 14:03:09.065124 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-f53a03a0-9822-47e4-bd2a-5ee59c64468a tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 14:03:09.065635 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-f53a03a0-9822-47e4-bd2a-5ee59c64468a tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 338889a2-1e31-4d64-87ef-ce9f18f4477c] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 14:03:09.072860 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f53a03a0-9822-47e4-bd2a-5ee59c64468a tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:03:09.073310 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f53a03a0-9822-47e4-bd2a-5ee59c64468a tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:03:09.074111 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f53a03a0-9822-47e4-bd2a-5ee59c64468a tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:03:09.074548 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-f53a03a0-9822-47e4-bd2a-5ee59c64468a tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:03:09.194845 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.policy [None req-f53a03a0-9822-47e4-bd2a-5ee59c64468a tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ea9144206a468fab90e65113903df0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84f3c43c33604ba0889f52e0fc038af6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87932) authorize /opt/stack/nova/nova/policy.py:199}} Apr 30 14:03:09.204184 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-f53a03a0-9822-47e4-bd2a-5ee59c64468a tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/338889a2-1e31-4d64-87ef-ce9f18f4477c" status: 200 len: 1226 microversion: 2.1 time: 0.142840 Apr 30 14:03:09.204760 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 932/1974] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 14:03:09 2021] GET /compute/v2.1/servers/338889a2-1e31-4d64-87ef-ce9f18f4477c => generated 1226 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 30 14:03:10.224030 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-c5a2c53f-3a60-4b3f-85fe-eb5540c982c9 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 14:03:10.224732 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-c5a2c53f-3a60-4b3f-85fe-eb5540c982c9 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 338889a2-1e31-4d64-87ef-ce9f18f4477c] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 14:03:10.232412 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c5a2c53f-3a60-4b3f-85fe-eb5540c982c9 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:03:10.232857 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c5a2c53f-3a60-4b3f-85fe-eb5540c982c9 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:03:10.233634 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c5a2c53f-3a60-4b3f-85fe-eb5540c982c9 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:03:10.234451 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-c5a2c53f-3a60-4b3f-85fe-eb5540c982c9 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:03:10.290935 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.wsgi [None req-c5a2c53f-3a60-4b3f-85fe-eb5540c982c9 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] HTTP exception thrown: Instance 338889a2-1e31-4d64-87ef-ce9f18f4477c could not be found. Apr 30 14:03:10.291531 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-c5a2c53f-3a60-4b3f-85fe-eb5540c982c9 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Returning 404 to user: Instance 338889a2-1e31-4d64-87ef-ce9f18f4477c could not be found. {{(pid=87933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 14:03:10.292368 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-c5a2c53f-3a60-4b3f-85fe-eb5540c982c9 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/338889a2-1e31-4d64-87ef-ce9f18f4477c" status: 404 len: 111 microversion: 2.1 time: 0.072565 Apr 30 14:03:10.292928 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 1043/1975] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 14:03:10 2021] GET /compute/v2.1/servers/338889a2-1e31-4d64-87ef-ce9f18f4477c => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 30 14:03:11.233084 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-b758b7e1-be4f-43fc-bae0-5061c9fbdb31 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 14:03:11.233697 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.compute.api [None req-b758b7e1-be4f-43fc-bae0-5061c9fbdb31 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 39664cb7-f41c-4aab-9708-827512370122] Fetching instance by UUID {{(pid=87932) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 14:03:11.242817 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b758b7e1-be4f-43fc-bae0-5061c9fbdb31 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:03:11.243271 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b758b7e1-be4f-43fc-bae0-5061c9fbdb31 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:03:11.244067 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b758b7e1-be4f-43fc-bae0-5061c9fbdb31 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:03:11.244507 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG oslo_concurrency.lockutils [None req-b758b7e1-be4f-43fc-bae0-5061c9fbdb31 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:03:11.301951 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.wsgi [None req-b758b7e1-be4f-43fc-bae0-5061c9fbdb31 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] HTTP exception thrown: Instance 39664cb7-f41c-4aab-9708-827512370122 could not be found. Apr 30 14:03:11.302535 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-b758b7e1-be4f-43fc-bae0-5061c9fbdb31 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Returning 404 to user: Instance 39664cb7-f41c-4aab-9708-827512370122 could not be found. {{(pid=87932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 14:03:11.303377 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-b758b7e1-be4f-43fc-bae0-5061c9fbdb31 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "DELETE /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122" status: 404 len: 111 microversion: 2.1 time: 0.074033 Apr 30 14:03:11.303937 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 933/1976] 10.222.0.79 () {58 vars in 1239 bytes} [Fri Apr 30 14:03:11 2021] DELETE /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 14:03:11.314616 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b8132535-fbf1-49d0-ad2c-aadb110be2e4 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '>' {{(pid=87933) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 14:03:11.315232 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.compute.api [None req-b8132535-fbf1-49d0-ad2c-aadb110be2e4 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] [instance: 39664cb7-f41c-4aab-9708-827512370122] Fetching instance by UUID {{(pid=87933) get /opt/stack/nova/nova/compute/api.py:2815}} Apr 30 14:03:11.324347 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b8132535-fbf1-49d0-ad2c-aadb110be2e4 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:03:11.324989 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b8132535-fbf1-49d0-ad2c-aadb110be2e4 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:03:11.325789 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b8132535-fbf1-49d0-ad2c-aadb110be2e4 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Apr 30 14:03:11.326272 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG oslo_concurrency.lockutils [None req-b8132535-fbf1-49d0-ad2c-aadb110be2e4 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Lock "c94c5757-8835-44de-a521-d4549117f41a" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=87933) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Apr 30 14:03:11.539405 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.wsgi [None req-b8132535-fbf1-49d0-ad2c-aadb110be2e4 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] HTTP exception thrown: Instance 39664cb7-f41c-4aab-9708-827512370122 could not be found. Apr 30 14:03:11.540050 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: DEBUG nova.api.openstack.wsgi [None req-b8132535-fbf1-49d0-ad2c-aadb110be2e4 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Returning 404 to user: Instance 39664cb7-f41c-4aab-9708-827512370122 could not be found. {{(pid=87933) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Apr 30 14:03:11.540892 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO nova.api.openstack.requestlog [None req-b8132535-fbf1-49d0-ad2c-aadb110be2e4 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "GET /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122" status: 404 len: 111 microversion: 2.1 time: 0.231012 Apr 30 14:03:11.541768 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: [pid: 87933|app: 0|req: 1044/1977] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Apr 30 14:03:11 2021] GET /compute/v2.1/servers/39664cb7-f41c-4aab-9708-827512370122 => generated 111 bytes in 232 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 30 14:03:13.046895 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: DEBUG nova.api.openstack.wsgi [None req-5786aa1e-fb17-4f68-90c7-4d4450a3c953 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] Calling method '.version_select at 0x7f7500ba3280>' {{(pid=87932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 30 14:03:13.069870 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO nova.api.openstack.requestlog [None req-5786aa1e-fb17-4f68-90c7-4d4450a3c953 tempest-TestVolumeBootPattern-2037760876 tempest-TestVolumeBootPattern-2037760876-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1132199581" status: 202 len: 0 microversion: 2.1 time: 0.026991 Apr 30 14:03:13.070399 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: [pid: 87932|app: 0|req: 934/1978] 10.222.0.79 () {58 vars in 1263 bytes} [Fri Apr 30 14:03:13 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1132199581 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 30 14:05:06.904546 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 14:05:06.905286 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: Fri Apr 30 14:05:06 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 14:05:22.667351 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 14:05:22.668261 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: Fri Apr 30 14:05:22 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 14:05:37.071814 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 14:05:37.072508 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: Fri Apr 30 14:05:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 14:06:42.873636 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 14:06:42.874472 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: Fri Apr 30 14:06:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 14:08:26.935998 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 14:08:26.936882 dv-cinder-788364-2-iscsi devstack@n-api.service[87932]: Fri Apr 30 14:08:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 14:08:41.929242 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 14:08:41.929839 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: Fri Apr 30 14:08:41 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 30 14:08:42.689566 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 30 14:08:42.689850 dv-cinder-788364-2-iscsi devstack@n-api.service[87933]: Fri Apr 30 14:08:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!